00000001:02000400:0.0F:1788360717.352689:0:2968:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788360730.606420:0:3188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788360731.824472:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 709 MB/s 00000001:01000000:3.0F:1788360732.074478:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 803 MB/s 00000001:01000000:0.0:1788360732.327435:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7027 MB/s 00000020:02000000:2.0:1788360732.960427:0:3280:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_2_ge76cbe5 00000400:02000000:0.0:1788360733.491757:0:3295:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.160@tcp [8/256/0/180] 00008000:02000000:0.0:1788360736.675980:0:3444:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788360775.068937:0:5248:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788360781.487388:0:5778:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788360781.487394:0:5778:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788360781.487537:0:5778:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000af515604 00000080:02000400:3.0:1788360781.487548:0:5778:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788360781.493177:0:5778:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788360781.493190:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788360781.493230:0:5778:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000018bb0ae3) 00000020:00000080:3.0:1788360781.493250:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788360781.515745:0:5778:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788360781.516283:0:5778:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788360781.542736:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788360781.542778:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788360781.542799:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788360781.543066:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788360781.543190:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788360781.543661:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788360781.543669:0:5778:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788360781.543679:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d660ff23 00000020:01000004:1.0:1788360781.543685:0:5778:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788360781.543689:0:5778:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788360781.543693:0:5778:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000af515604 from MGS 00000020:01000004:1.0:1788360781.543697:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788360781.543715:0:5778:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e87b75f1) 00000020:00000080:1.0:1788360781.543727:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788360781.543790:0:5778:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000af515604 from MGS, refs=2 00080000:01000000:1.0:1788360781.543794:0:5778:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788360781.543799:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d660ff31 00000100:00100000:1.0:1788360781.544190:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788360781.544384:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788360781.544391:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788360781.545063:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788360781.545071:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788360781.546613:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360781.546748:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788360781.546753:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788360781.548031:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788360781.548042:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788360781.549424:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788360781.549445:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788360781.551583:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360781.551588:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360781.551590:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360781.551912:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360781.551914:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360781.551916:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360781.552567:0:5778:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788360781.557215:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788360781.802561:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3627 MB/s 00000001:01000000:0.0:1788360782.053344:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3820 MB/s 00000001:01000000:3.0:1788360782.303375:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 783 MB/s 00000001:01000000:3.0:1788360782.553344:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1039 MB/s 00010000:00010000:0.0:1788360782.560326:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788360782.562765:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788360782.579486:0:5778:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788360782.579504:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788360782.579506:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788360782.580416:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788360782.580482:0:5778:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788360782.580524:0:5778:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788360782.580693:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788360782.580714:0:5778:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788360782.581191:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360782.581349:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788360782.581354:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788360782.589972:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788360782.589987:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788360782.591218:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788360782.591253:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788360782.592268:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788360782.592288:0:5778:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.160@tcp' 00000020:01000004:3.0:1788360782.592290:0:5778:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788360782.592381:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.160@tcp (typ=mgc) 00000020:00000080:3.0:1788360782.592392:0:5778:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.160@tcp (00000000ab65df0a) 00000020:00000080:3.0:1788360782.592410:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788360782.592500:0:5778:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000056f63407@MGC192.168.203.160@tcp: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788360782.592656:0:5778:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.160@tcp-0 is initialized 00000040:01000000:3.0:1788360782.592662:0:5778:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788360782.593741:0:5794:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788360782.595344:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.160@tcp (uuid d9fa3464-d771-4fa1-895d-6f4c1383568d) 00000020:00000080:3.0:1788360782.595380:0:5778:0:(genops.c:1406:class_connect()) connect: client d9fa3464-d771-4fa1-895d-6f4c1383568d, cookie 0xf6a94c97d660ff3f 00000100:00080000:3.0:1788360782.595392:0:5778:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788360782.595398:0:5778:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import 0000000056f63407 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788360782.595440:0:5778:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b5745917 x1875232143966336/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788360782.595461:0:5778:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS 00000020:01000004:3.0:1788360782.595483:0:5778:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788360782.595488:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788360782.595499:0:5778:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000520a44c8) 00000020:00000080:3.0:1788360782.595512:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788360782.598680:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000b5745917 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d9fa3464-d771-4fa1-895d-6f4c1383568d:3310:1875232143966336:0@lo:250: 00000100:00100000:0.0:1788360782.598753:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360782.599554:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143966336 00000100:00100000:1.0:1788360782.599565:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143966336 00000100:00100000:1.0:1788360782.599598:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788360782.599605:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c5152a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1875232143966336:12345-0@lo:250: 00010000:00080000:1.0:1788360782.599881:0:5789:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d9fa3464-d771-4fa1-895d-6f4c1383568d@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1788360782.599911:0:5789:0:(genops.c:1406:class_connect()) connect: client d9fa3464-d771-4fa1-895d-6f4c1383568d, cookie 0xf6a94c97d660ff4d 00000100:00080000:1.0:1788360782.600067:0:5789:0:(import.c:65:import_set_state_nolock()) 0000000001ff7f9a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788360782.600271:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c5152a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:3310:x1875232143966336:12345-0@lo:250: Request processed in 665us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360782.600279:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788360782.600348:0:5793:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1788360782.600498:0:3310:0:(client.c:3115:ptlrpc_free_committed()) MGC192.168.203.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788360782.600508:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.160@tcp: connect to target with instance 0 00000100:00080000:0.0:1788360782.600515:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788360782.600520:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788360782.600522:0:3310:0:(import.c:65:import_set_state_nolock()) 0000000056f63407 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788360782.600526:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788360782.600546:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788360782.600551:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000b5745917 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d9fa3464-d771-4fa1-895d-6f4c1383568d:3310:1875232143966336:0@lo:250: 00000100:00100000:3.0:1788360782.610058:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360782.610276:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788360782.610282:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788360782.612789:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788360782.612801:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788360782.615557:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788360782.615571:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788360782.617566:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360782.617726:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788360782.617740:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788360782.620324:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788360782.620337:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788360782.653341:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360782.653670:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788360782.653676:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788360782.655898:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788360782.655912:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788360782.656727:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360782.656898:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788360782.656904:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788360782.657643:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788360782.657651:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788360782.658305:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360782.658604:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788360782.658610:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788360782.659049:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788360782.659055:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788360782.659861:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360782.659998:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788360782.660004:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788360782.660741:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788360782.660750:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788360782.681989:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788360782.682576:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788360782.682583:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788360782.683769:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788360782.683780:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788360782.685599:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788360782.685612:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788360782.687080:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788360782.687223:0:5778:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788360782.687230:0:5778:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788360782.687475:0:5778:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788360782.687515:0:5778:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788360782.687520:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788360782.687522:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788360782.687523:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360782.687525:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788360782.687526:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360782.687527:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360782.687528:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788360782.687530:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788360782.687532:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788360782.687533:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788360782.687535:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360782.687536:0:5778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788360782.687538:0:5778:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788360782.687540:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788360782.687541:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788360782.687546:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360782.687547:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788360782.687548:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360782.687549:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360782.687550:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788360782.687551:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788360782.687551:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788360782.687552:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788360782.687553:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360782.687554:0:5778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788360782.687586:0:5778:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788360782.687603:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000d3f1e99a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143966464:0@lo:253: 00000100:00100000:2.0:1788360782.687687:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360782.687824:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000073f3d967 going to sleep for 11 seconds 00000100:00100000:1.0:1788360782.687873:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143966464 00000100:00100000:1.0:1788360782.687882:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143966464 00000100:00100000:1.0:1788360782.687999:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788360782.688007:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d50efc28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:5778:x1875232143966464:12345-0@lo:253: 20000000:01000000:1.0:1788360782.688055:0:5792:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788360782.688058:0:5792:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788360782.688762:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788360782.688813:0:5792:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788360782.689221:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788360782.690242:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788360782.690590:0:5792:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788360782.690594:0:5792:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788360782.690600:0:5792:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788360782.690603:0:5792:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788360782.690618:0:5792:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788360782.690801:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788360782.691023:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788360782.691037:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788360782.691339:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788360782.691530:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788360782.691569:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788360782.691659:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788360782.691667:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788360782.691709:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788360782.691717:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788360782.691749:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788360782.691757:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788360782.691786:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788360782.691861:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788360782.691892:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788360782.691898:0:5792:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788360782.691911:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788360782.694545:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788360782.694572:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788360782.694634:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788360782.694667:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788360782.694714:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788360782.694728:0:5792:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788360782.694832:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788360782.694841:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788360782.694901:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788360782.694938:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788360782.694971:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788360782.694982:0:5792:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788360782.695066:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788360782.695075:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788360782.695265:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788360782.695300:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788360782.695592:0:5792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788360782.695637:0:5792:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788360782.695644:0:5792:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788360782.696245:0:5815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788360782.696661:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788360782.696683:0:5792:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.160@tcp for mdt 20000000:01000000:1.0:1788360782.696685:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.160@tcp (null) (null) (null) 00000040:00080000:1.0:1788360782.696719:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788360782.696726:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788360782.696756:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788360782.696763:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.160@tcp (null) (null) 00000040:00080000:1.0:1788360782.696807:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788360782.696817:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788360782.696873:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788360782.696924:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788360782.696982:0:5792:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788360782.696986:0:5792:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788360782.696991:0:5792:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788360782.696997:0:5792:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788360782.697567:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788360782.697700:0:5792:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788360782.705438:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788360782.705491:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788360782.705564:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788360782.705581:0:5792:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788360782.705584:0:5792:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788360782.705587:0:5792:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788360782.705601:0:5792:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788360782.705604:0:5792:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788360782.705636:0:5792:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788360782.705638:0:5792:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788360782.706417:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788360782.706681:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788360782.706722:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788360782.706783:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1788360782.706796:0:5792:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788360782.706798:0:5792:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788360782.707491:0:5818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788360782.707689:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788360782.707724:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788360782.707762:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788360782.707775:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788360782.707778:0:5792:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788360782.707784:0:5792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788360782.707801:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.707828:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.707838:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.707855:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.707862:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.707872:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.707878:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000884006fe already unused, calling callback (00000000793830d7) 00010000:00010000:0.0:1788360782.707881:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.707888:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.707901:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.707907:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.707912:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000884006fe/0xf6a94c97d660ff54 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788360782.707941:0:5792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788360782.913606:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d50efc28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:5778:x1875232143966464:12345-0@lo:253: Request processed in 225593us (225913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360782.913626:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788360782.913731:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000d3f1e99a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143966464:0@lo:253: 10000000:01000000:2.0:1788360782.913746:0:5778:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788360782.913749:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788360782.913752:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788360782.913753:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360782.913754:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788360782.913755:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360782.913756:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360782.913758:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788360782.913759:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788360782.913761:0:5778:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788360782.913762:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360782.913764:0:5778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788360782.913781:0:5778:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000af515604 from lustre-MDT0000 10000000:01000000:2.0:1788360782.913805:0:5778:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788360782.913808:0:5778:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788360782.913824:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a8a85713380 10000000:01000000:2.0:1788360782.913828:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788360782.913837:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a8a85713380 from 1 10000000:01000000:2.0:1788360782.913861:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788360782.913895:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360782.913905:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360782.913913:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360782.913931:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000d3f1e99a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143966592:0@lo:101: 00000100:00100000:2.0:1788360782.913976:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360782.914033:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 000000003d103ee7 going to sleep for 11 seconds 00000100:00100000:3.0:1788360782.914118:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143966592 00000100:00100000:3.0:1788360782.914124:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143966592 00000100:00100000:3.0:1788360782.914159:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788360782.914166:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbf2943b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:5778:x1875232143966592:12345-0@lo:101: 00010000:00010000:3.0:1788360782.914178:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360782.914192:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce16f992/0xf6a94c97d660ff62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d660ff5b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360782.914213:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce16f992/0xf6a94c97d660ff62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d660ff5b expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360782.914223:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce16f992/0xf6a94c97d660ff62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ff5b expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360782.914238:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce16f992, rc 0) 00000100:00100000:3.0:1788360782.914278:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbf2943b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+6:5778:x1875232143966592:12345-0@lo:101: Request processed in 113us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360782.914284:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788360782.914638:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000d3f1e99a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143966592:0@lo:101: 00010000:00010000:0.0:1788360782.914652:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.914660:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360782.914723:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143966720:0@lo:501: 00000100:00100000:0.0:1788360782.914751:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360782.914822:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000022ccd4d5 going to sleep for 11 seconds 00000100:00100000:2.0:1788360782.914931:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143966720 00000100:00100000:2.0:1788360782.914936:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143966720 00000100:00100000:2.0:1788360782.915017:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788360782.915024:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e290e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+6:5778:x1875232143966720:12345-0@lo:501: 00000100:00100000:2.0:1788360782.915389:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e290e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+6:5778:x1875232143966720:12345-0@lo:501: Request processed in 366us (637us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788360782.915396:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788360782.915456:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143966720:0@lo:501: 10000000:01000000:0.0:1788360782.915485:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788360782.915502:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.915509:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360782.915517:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8a83778000 10000000:01000000:0.0:1788360782.915521:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788360782.915525:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a8a83778000 10000000:01000000:0.0:1788360782.915527:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788360782.915529:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a8a83778000 from 1 10000000:01000000:0.0:1788360782.915539:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788360782.915561:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 00000000884006fe/0xf6a94c97d660ff69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.915568:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 00000000884006fe/0xf6a94c97d660ff69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.915576:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 00000000884006fe/0xf6a94c97d660ff69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360782.915588:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143966848:0@lo:101: 00000100:00100000:0.0:1788360782.915615:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360782.915792:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000022ccd4d5 going to sleep for 11 seconds 00000100:00100000:3.0:1788360782.915874:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143966848 00000100:00100000:3.0:1788360782.915880:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143966848 00000100:00100000:3.0:1788360782.915904:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788360782.915909:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005132bcc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+6:5778:x1875232143966848:12345-0@lo:101: 00010000:00010000:3.0:1788360782.915919:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360782.915929:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ac506db/0xf6a94c97d660ff70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d660ff69 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360782.915945:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ac506db/0xf6a94c97d660ff70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d660ff69 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360782.915953:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ac506db/0xf6a94c97d660ff70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ff69 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360782.915960:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ac506db, rc 0) 00000100:00100000:3.0:1788360782.915998:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005132bcc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+7:5778:x1875232143966848:12345-0@lo:101: Request processed in 89us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360782.916004:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788360782.916101:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143966848:0@lo:101: 00010000:00010000:0.0:1788360782.916122:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 00000000884006fe/0xf6a94c97d660ff69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.916129:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 00000000884006fe/0xf6a94c97d660ff69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360782.916140:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788360782.916155:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 00000000884006fe/0xf6a94c97d660ff69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.916161:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 00000000884006fe/0xf6a94c97d660ff69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360782.916167:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788360782.916170:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788360782.916174:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a8a83778000 10000000:01000000:0.0:1788360782.916184:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788360782.916188:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788360782.916190:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788360782.916203:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.916209:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.916215:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360782.916226:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143966976:0@lo:101: 00000100:00100000:0.0:1788360782.916249:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360782.916261:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000022ccd4d5 going to sleep for 11 seconds 00000100:00100000:3.0:1788360782.916379:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143966976 00000100:00100000:3.0:1788360782.916383:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143966976 00000100:00100000:3.0:1788360782.916401:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788360782.916406:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b05d7e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+7:5778:x1875232143966976:12345-0@lo:101: 00010000:00010000:3.0:1788360782.916413:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360782.916425:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000006e29336/0xf6a94c97d660ff7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d660ff77 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360782.916439:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006e29336/0xf6a94c97d660ff7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d660ff77 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360782.916446:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000006e29336/0xf6a94c97d660ff7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ff77 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360782.916452:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000006e29336, rc 0) 00000100:00100000:3.0:1788360782.916490:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b05d7e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+8:5778:x1875232143966976:12345-0@lo:101: Request processed in 84us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360782.916496:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788360782.916563:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143966976:0@lo:101: 00010000:00010000:0.0:1788360782.916572:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360782.916578:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360782.916615:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143967104:0@lo:501: 00000100:00100000:0.0:1788360782.916637:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360782.916661:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000022ccd4d5 going to sleep for 11 seconds 00000100:00100000:3.0:1788360782.916710:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143967104 00000100:00100000:3.0:1788360782.916714:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143967104 00000100:00100000:3.0:1788360782.916732:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788360782.916737:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005054bc28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+8:5778:x1875232143967104:12345-0@lo:501: 00000100:00100000:3.0:1788360782.916952:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005054bc28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:5778:x1875232143967104:12345-0@lo:501: Request processed in 215us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360782.916960:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788360782.917102:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143967104:0@lo:501: 00000100:00100000:0.0:1788360782.917200:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143967232:0@lo:503: 00000100:00100000:0.0:1788360782.917237:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360782.917271:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000022ccd4d5 going to sleep for 11 seconds 00000100:00100000:3.0:1788360782.917324:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143967232 00000100:00100000:3.0:1788360782.917328:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143967232 00000100:00100000:3.0:1788360782.917358:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788360782.917364:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085c4ca24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:5778:x1875232143967232:12345-0@lo:503: 00000100:00100000:3.0:1788360782.917607:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085c4ca24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:5778:x1875232143967232:12345-0@lo:503: Request processed in 242us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360782.917614:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788360782.917727:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143967232:0@lo:503: 00000100:00100000:2.0:1788360782.918080:0:5820:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000f02ec97b pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:5820:1875232143967360:0@lo:502: 00000100:00100000:2.0:1788360782.918208:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360782.918276:0:5820:0:(client.c:2705:ptlrpc_set_wait()) set 000000004d7e585c going to sleep for 11 seconds 00000100:00100000:0.0:1788360782.918314:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143967360 00000100:00100000:0.0:1788360782.918319:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143967360 00000100:00100000:0.0:1788360782.918395:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788360782.918402:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c497331c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:5820:x1875232143967360:12345-0@lo:502: 00000100:00100000:0.0:1788360782.918567:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c497331c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:5820:x1875232143967360:12345-0@lo:502: Request processed in 166us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360782.918573:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788360782.918643:0:5820:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000f02ec97b pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:5820:1875232143967360:0@lo:502: 00000020:01000000:2.0:1788360782.918667:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788360782.918677:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788360782.918680:0:5820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788360782.918683:0:5820:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788360782.918687:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788360782.918711:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d6838d08) 00000020:00000080:2.0:1788360782.918728:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788360782.918734:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788360782.918835:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788360782.918853:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d660ff8c 00000020:00000080:2.0:1788360782.919057:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788360782.919062:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788360782.919066:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788360782.919067:0:5820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788360782.919069:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788360782.919072:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788360782.919074:0:5820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788360782.919077:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788360782.919082:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000da831cc5) 00000020:00000080:2.0:1788360782.919140:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788360782.919145:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788360782.919146:0:5820:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788360782.919149:0:5820:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788360782.919154:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788360782.919194:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000af515604 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788360782.919205:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a85f73a9) 00000020:00000080:2.0:1788360782.919212:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788360782.919275:0:5820:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788360782.919281:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d660ffa1 00000020:00000080:2.0:1788360782.919387:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788360782.919393:0:5820:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788360782.919396:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf6a94c97d660ffa8 00080000:01000000:2.0:1788360782.919401:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788360782.919403:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d660ffaf 00080000:10000000:2.0:1788360782.919719:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788360782.919889:0:5820:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788360782.924241:0:5820:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788360782.980980:0:5820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788360782.981537:0:5820:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788360782.984303:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788360782.984591:0:5820:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788360783.004823:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d5ca6671) 00000020:00000080:3.0:1788360783.004854:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788360783.004933:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788360783.004941:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d660ffbd 00000020:00000080:3.0:1788360783.005514:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788360783.006783:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788360783.037969:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788360783.059242:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788360783.085080:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788360783.124997:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788360783.156019:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788360783.179626:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf6a94c97d660ffc4 00000020:00000080:0.0:1788360783.180146:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788360783.180157:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360783.180163:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360783.180165:0:5820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788360783.180168:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788360783.180173:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360783.180175:0:5820:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788360783.180179:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788360783.180213:0:5820:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788360783.180224:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360783.180227:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360783.180229:0:5820:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788360783.180232:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788360783.180234:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360783.180236:0:5820:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788360783.180238:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788360783.180240:0:5820:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788360783.180279:0:5820:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:5820:1875232143967488:0@lo:502: 00000100:00100000:0.0:1788360783.180355:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360783.180409:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143967488 00000100:00100000:1.0:1788360783.180417:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143967488 00000100:00100000:0.0:1788360783.180418:0:5820:0:(client.c:2705:ptlrpc_set_wait()) set 000000001ea5f394 going to sleep for 11 seconds 00000100:00100000:1.0:1788360783.180456:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788360783.180463:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065876fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:5820:x1875232143967488:12345-0@lo:502: 00000100:00100000:1.0:1788360783.180777:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065876fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:5820:x1875232143967488:12345-0@lo:502: Request processed in 314us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360783.180800:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788360783.180809:0:5820:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:5820:1875232143967488:0@lo:502: 00000020:01000000:0.0:1788360783.180853:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360783.180858:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360783.180860:0:5820:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788360783.180864:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788360783.181182:0:5778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788360783.181205:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788360783.181265:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.181276:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360783.181285:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8a83778000 from 1 10000000:01000000:2.0:1788360783.181287:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788360783.181313:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.181320:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.181328:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360783.181342:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000f02ec97b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143967616:0@lo:101: 00000100:00100000:2.0:1788360783.181373:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360783.181400:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000042f3fc09 going to sleep for 11 seconds 00000100:00100000:0.0:1788360783.181485:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143967616 00000100:00100000:0.0:1788360783.181490:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143967616 00000100:00100000:0.0:1788360783.181526:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788360783.181533:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d2f6ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:5778:x1875232143967616:12345-0@lo:101: 00010000:00010000:0.0:1788360783.181543:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360783.181555:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce9cf7da/0xf6a94c97d660ffd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d660ffcb expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360783.181573:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce9cf7da/0xf6a94c97d660ffd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d660ffcb expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360783.181583:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce9cf7da/0xf6a94c97d660ffd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ffcb expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360783.181591:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce9cf7da, rc 0) 00000100:00100000:0.0:1788360783.181620:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d2f6ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:5778:x1875232143967616:12345-0@lo:101: Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360783.181626:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788360783.181750:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000f02ec97b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143967616:0@lo:101: 00010000:00010000:2.0:1788360783.181761:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.181769:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360783.182564:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000f02ec97b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143967744:0@lo:256: 00000100:00100000:2.0:1788360783.182613:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360783.182746:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000042f3fc09 going to sleep for 11 seconds 00000100:00100000:1.0:1788360783.182803:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143967744 00000100:00100000:1.0:1788360783.182808:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143967744 00000100:00100000:1.0:1788360783.182881:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788360783.182889:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000276ac4fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:5778:x1875232143967744:12345-0@lo:256: 20000000:01000000:1.0:1788360783.182907:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788360783.182922:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788360783.182996:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000276ac4fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:5778:x1875232143967744:12345-0@lo:256: Request processed in 108us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360783.183003:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788360783.183067:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000f02ec97b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143967744:0@lo:256: 10000000:01000000:2.0:1788360783.183680:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788360783.183691:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.183701:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360783.183709:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a83778000 from 1 10000000:01000000:2.0:1788360783.183712:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788360783.183738:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.183744:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.183752:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360783.183766:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000f02ec97b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143967872:0@lo:101: 00000100:00100000:2.0:1788360783.183796:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360783.183822:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000042f3fc09 going to sleep for 11 seconds 00000100:00100000:1.0:1788360783.183904:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143967872 00000100:00100000:1.0:1788360783.183910:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143967872 00000100:00100000:1.0:1788360783.183941:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788360783.183947:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077bb90ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:5778:x1875232143967872:12345-0@lo:101: 00010000:00010000:1.0:1788360783.183957:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360783.183973:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007cb15f1f/0xf6a94c97d660ffe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d660ffd9 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360783.184054:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007cb15f1f/0xf6a94c97d660ffe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d660ffd9 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360783.184066:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007cb15f1f/0xf6a94c97d660ffe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ffd9 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360783.184075:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007cb15f1f, rc 0) 00000100:00100000:1.0:1788360783.184198:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077bb90ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:5778:x1875232143967872:12345-0@lo:101: Request processed in 251us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360783.184205:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788360783.184276:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000f02ec97b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143967872:0@lo:101: 00010000:00010000:0.0:1788360783.184287:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360783.184293:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360783.184349:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143968000:0@lo:501: 00000100:00100000:0.0:1788360783.184369:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360783.184390:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 000000000f3d9898 going to sleep for 11 seconds 00000100:00100000:1.0:1788360783.184428:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143968000 00000100:00100000:1.0:1788360783.184433:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143968000 00000100:00100000:1.0:1788360783.184497:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788360783.184504:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002951a29e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:5778:x1875232143968000:12345-0@lo:501: 00000100:00100000:1.0:1788360783.185530:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002951a29e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:5778:x1875232143968000:12345-0@lo:501: Request processed in 1024us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360783.185540:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788360783.185625:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143968000:0@lo:501: 00000100:00100000:0.0:1788360783.185755:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143968128:0@lo:503: 00000100:00100000:0.0:1788360783.185796:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360783.185827:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 000000000f3d9898 going to sleep for 11 seconds 00000100:00100000:1.0:1788360783.185850:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143968128 00000100:00100000:1.0:1788360783.185856:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143968128 00000100:00100000:1.0:1788360783.185891:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788360783.185897:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008197c2b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:5778:x1875232143968128:12345-0@lo:503: 00000040:00080000:1.0:1788360783.185931:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788360783.185973:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008197c2b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:5778:x1875232143968128:12345-0@lo:503: Request processed in 76us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360783.185980:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788360783.186018:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000095e89676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143968128:0@lo:503: 00000040:00080000:0.0:1788360783.187308:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788360783.187475:0:5778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788360783.187494:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788360783.187514:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.187536:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360783.187596:0:5778:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788360783.187599:0:5778:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a83778000 10000000:01000000:2.0:1788360783.187602:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a83778000 10000000:01000000:2.0:1788360783.187606:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788360783.187611:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a83778000 from 1 10000000:01000000:2.0:1788360783.187613:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788360783.187639:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.187646:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.188001:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360783.188021:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000098fe019a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143968256:0@lo:101: 00000100:00100000:2.0:1788360783.188071:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360783.188239:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143968256 00000100:00100000:1.0:1788360783.188246:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143968256 00000100:00100000:2.0:1788360783.188269:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000054615351 going to sleep for 11 seconds 00000100:00100000:1.0:1788360783.188491:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788360783.188501:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7e88cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:5778:x1875232143968256:12345-0@lo:101: 00010000:00010000:1.0:1788360783.188514:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360783.188525:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000252c7b8d/0xf6a94c97d660ffee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d660ffe7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360783.188546:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000252c7b8d/0xf6a94c97d660ffee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d660ffe7 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360783.188555:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000252c7b8d/0xf6a94c97d660ffee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ffe7 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360783.188576:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000252c7b8d, rc 0) 00000100:00100000:1.0:1788360783.188619:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7e88cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5778:x1875232143968256:12345-0@lo:101: Request processed in 120us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360783.188626:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788360783.188672:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000098fe019a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143968256:0@lo:101: 00010000:00010000:2.0:1788360783.188684:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.188693:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360783.188749:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000098fe019a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143968384:0@lo:501: 00000100:00100000:2.0:1788360783.188773:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360783.188793:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000054615351 going to sleep for 11 seconds 00000100:00100000:0.0:1788360783.188899:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143968384 00000100:00100000:0.0:1788360783.188904:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143968384 00000100:00100000:0.0:1788360783.188943:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788360783.188949:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee063547 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5778:x1875232143968384:12345-0@lo:501: 00000100:00100000:0.0:1788360783.189236:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee063547 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5778:x1875232143968384:12345-0@lo:501: Request processed in 288us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360783.189243:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788360783.189408:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000098fe019a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143968384:0@lo:501: 00000100:00100000:2.0:1788360783.189434:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000098fe019a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143968512:0@lo:503: 00000100:00100000:2.0:1788360783.189468:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360783.189503:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 0000000054615351 going to sleep for 11 seconds 00000100:00100000:1.0:1788360783.189558:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143968512 00000100:00100000:1.0:1788360783.189562:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143968512 00000100:00100000:1.0:1788360783.189623:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788360783.189630:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059a005a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5778:x1875232143968512:12345-0@lo:503: 00000100:00100000:1.0:1788360783.189926:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059a005a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5778:x1875232143968512:12345-0@lo:503: Request processed in 297us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360783.189932:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788360783.189999:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000098fe019a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143968512:0@lo:503: 00000100:00100000:2.0:1788360783.190487:0:5825:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000098fe019a pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:5825:1875232143968640:0@lo:502: 00000100:00100000:2.0:1788360783.190522:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360783.190917:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143968640 00000100:00100000:0.0:1788360783.190923:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143968640 00000100:00100000:0.0:1788360783.190949:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788360783.190956:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b2fbba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5825:x1875232143968640:12345-0@lo:502: 00000100:00100000:2.0:1788360783.191207:0:5825:0:(client.c:2705:ptlrpc_set_wait()) set 0000000013e98220 going to sleep for 11 seconds 00000100:00100000:0.0:1788360783.191343:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b2fbba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5825:x1875232143968640:12345-0@lo:502: Request processed in 388us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360783.191351:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788360783.191428:0:5825:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000098fe019a pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:5825:1875232143968640:0@lo:502: 00000020:01000004:2.0:1788360783.191482:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788360783.191495:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006f695a68) 00000020:00000080:2.0:1788360783.191512:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788360783.191813:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000af515604 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788360783.191817:0:5825:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000af515604 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788360783.191819:0:5825:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000af515604 4 00010000:00080000:2.0:1788360783.191856:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000030a2e342@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788360783.200468:0:5825:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788360783.200586:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788360783.200621:0:5825:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788360783.200645:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf6a94c97d660fffc 00000100:00080000:3.0:1788360783.200660:0:5825:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788360783.200664:0:5825:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000030a2e342 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788360783.200694:0:5825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000d44ed91 x1875232143968768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788360783.200720:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788360783.202776:0:5825:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000007160839d pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:5825:1875232143968896:0@lo:502: 00000100:00100000:3.0:1788360783.202877:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360783.202920:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143968896 00000100:00100000:3.0:1788360783.202927:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143968896 00000100:00100000:2.0:1788360783.202984:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000000d44ed91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232143968768:0@lo:38: 00000100:00100000:3.0:1788360783.202986:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788360783.203000:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000642e4447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5825:x1875232143968896:12345-0@lo:502: 00000100:00100000:2.0:1788360783.203028:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360783.203081:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143968768 00000100:00100000:2.0:1788360783.203099:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143968768 00000100:00100000:2.0:1788360783.203126:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788360783.203138:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098fe019a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232143968768:12345-0@lo:38: 00000100:00100000:2.0:1788360783.203188:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098fe019a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232143968768:12345-0@lo:38: Request processed in 49us (159us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788360783.203195:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788360783.203232:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788360783.203240:0:3310:0:(import.c:65:import_set_state_nolock()) 0000000030a2e342 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788360783.203244:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788360783.203248:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000000d44ed91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232143968768:0@lo:38: 00000100:00100000:3.0:1788360783.203809:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000642e4447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5825:x1875232143968896:12345-0@lo:502: Request processed in 811us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360783.203825:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788360783.203907:0:5825:0:(client.c:2705:ptlrpc_set_wait()) set 00000000c7845161 going to sleep for 11 seconds 00000100:00100000:3.0:1788360783.203924:0:5825:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000007160839d pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:5825:1875232143968896:0@lo:502: 00000040:00080000:3.0:1788360783.204014:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788360783.204132:0:5778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788360783.204162:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788360783.204177:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360783.204188:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788360783.204238:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788360783.204241:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788360783.204242:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360783.204243:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788360783.204245:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360783.204246:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360783.204248:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788360783.204250:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788360783.204252:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788360783.204253:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788360783.204255:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360783.204256:0:5778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788360783.204260:0:5778:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788360783.204263:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788360783.204264:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788360783.204265:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360783.204267:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788360783.204273:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360783.204275:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360783.204276:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788360783.204277:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788360783.204278:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788360783.204279:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788360783.204280:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360783.204281:0:5778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788360783.204299:0:5778:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788360783.204311:0:5778:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000007d770d6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143969024:0@lo:253: 00000100:00100000:2.0:1788360783.204350:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360783.204373:0:5778:0:(client.c:2705:ptlrpc_set_wait()) set 000000002dab4569 going to sleep for 11 seconds 00000100:00100000:3.0:1788360783.204438:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143969024 00000100:00100000:3.0:1788360783.204444:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143969024 00000100:00100000:3.0:1788360783.204483:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788360783.204493:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011aedefe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5778:x1875232143969024:12345-0@lo:253: 20000000:01000000:3.0:1788360783.204516:0:5791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788360783.204529:0:5791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788360783.249860:0:5791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788360783.250115:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788360783.250758:0:5813:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788360783.250764:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788360783.250784:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.250801:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ce9cf7da/0xf6a94c97d660ffd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ffcb expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.250808:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.250859:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ce9cf7da/0xf6a94c97d660ffd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d660ffcb expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.250873:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ce9cf7da/0xf6a94c97d660ffd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d660ffcb expref: 12 pid: 5792 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360783.250887:0:5813:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000007160839d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1875232143969152:0@lo:104: 00000100:00100000:3.0:1788360783.252372:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360783.252458:0:5813:0:(client.c:2705:ptlrpc_set_wait()) set 00000000adaee559 going to sleep for 11 seconds 00000100:00100000:1.0:1788360783.252727:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143969152 00000100:00100000:1.0:1788360783.252736:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143969152 00000100:00100000:1.0:1788360783.252786:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788360783.252795:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c725bc56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5813:x1875232143969152:12345-0@lo:104: 00010000:00010000:1.0:1788360783.252807:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360783.252887:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788360783.252893:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c725bc56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5813:x1875232143969152:12345-0@lo:104: Request processed in 100us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360783.252899:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788360783.254061:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788360783.254069:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254079:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bf6b8ef4 already unused, calling callback (0000000068c85d4b) 10000000:00010000:3.0:1788360783.254083:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360783.254189:0:5813:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000007160839d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1875232143969152:0@lo:104: 00010000:00010000:3.0:1788360783.254197:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360783.254207:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360783.254214:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788360783.254228:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254255:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254263:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360783.254282:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254288:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: 00000000bf6b8ef4/0xf6a94c97d660ffcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ffd2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254308:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360783.254310:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360783.254311:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360783.254344:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000003f49118d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143969280:0@lo:103: 00000100:00100000:0.0:1788360783.254395:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360783.254651:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143969280 00000100:00100000:3.0:1788360783.254658:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143969280 00010000:00010000:3.0:1788360783.254678:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ce9cf7da/0xf6a94c97d660ffd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d660ffcb expref: 13 pid: 5792 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360783.254718:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788360783.254725:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8129cb2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3312:x1875232143969280:12345-0@lo:103: 00010000:00010000:3.0:1788360783.254736:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360783.254741:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ce9cf7da/0xf6a94c97d660ffd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d660ffcb expref: 13 pid: 5792 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254750:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ce9cf7da/0xf6a94c97d660ffd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d660ffcb expref: 13 pid: 5792 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254761:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce9cf7da/0xf6a94c97d660ffd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d660ffcb expref: 13 pid: 5792 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254773:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254780:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788360783.254792:0:5782:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004028956s 00010000:00010000:3.0:1788360783.254795:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254801:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254805:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254810:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254822:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000019a54fa4 already unused, calling callback (00000000793830d7) 00010000:00010000:3.0:1788360783.254825:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254832:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254857:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360783.254868:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788360783.254880:0:5813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360783.254890:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360783.254895:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019a54fa4/0xf6a94c97d6610003 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360783.254917:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8129cb2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:3312:x1875232143969280:12345-0@lo:103: Request processed in 193us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360783.254925:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788360783.255275:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000003f49118d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143969280:0@lo:103: 00000100:00100000:0.0:1788360783.264142:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011aedefe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:5778:x1875232143969024:12345-0@lo:253: Request processed in 59644us (59784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360783.264158:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788360783.264363:0:5778:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000007d770d6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:5778:1875232143969024:0@lo:253: 10000000:01000000:2.0:1788360783.264377:0:5778:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788360783.264380:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788360783.264382:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788360783.264384:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360783.264385:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788360783.264386:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360783.264387:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360783.264389:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788360783.264390:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788360783.264391:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788360783.264392:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788360783.264394:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360783.264395:0:5778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788360783.265020:0:5778:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788360783.273719:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788360783.274417:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788360783.274665:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788360783.274829:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788360783.275745:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788360783.275927:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788360783.276817:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788360783.277697:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788360783.278352:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788360783.278549:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788360783.279011:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788360783.279435:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788360783.320114:0:5778:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788360783.364257:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788360783.364334:0:5830:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788360783.364338:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788360783.364701:0:5831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788360783.369589:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788360783.369792:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788360783.373643:0:5778:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788360783.373665:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788360783.373937:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788360783.375824:0:5778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788360783.379566:0:5778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788360783.380668:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788360783.380984:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788360783.381210:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788360783.382531:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788360783.382684:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788360783.382819:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788360783.382979:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788360783.383137:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788360783.383298:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788360783.383439:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788360783.383606:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788360783.383754:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788360783.385311:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788360783.388600:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788360783.388877:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788360783.390599:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788360783.390819:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788360783.393298:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788360783.397057:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788360783.399639:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788360783.399831:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788360783.402531:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788360783.402757:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788360783.402925:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788360783.403515:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788360783.403669:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788360783.403833:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788360783.404257:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788360783.404535:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788360783.404706:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788360783.404928:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788360783.405912:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788360783.406344:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788360783.406675:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788360783.406833:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788360783.407169:0:5778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788360783.426574:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788360783.476873:0:5778:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788360783.476910:0:5778:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa998c1823988 00100000:10000000:3.0:1788360783.476920:0:5778:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788360783.477727:0:5778:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788360783.477740:0:5778:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788360783.477754:0:5778:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788360783.477769:0:5778:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788360783.523205:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788360783.523278:0:5831:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788360783.523282:0:5831:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788360783.588744:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360784.617067:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360785.632240:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360786.657619:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788360786.823064:0:6073:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788360787.681277:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788360788.641765:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788360788.641776:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788360788.641779:0:38:0:(import.c:65:import_set_state_nolock()) 0000000030a2e342 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788360788.641793:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000030a2e342 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788360788.641828:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000057ff5c63 x1875232143969536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788360788.641868:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000057ff5c63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232143969536:0@lo:38: 00000100:00100000:2.0:1788360788.641935:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360788.642026:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143969536 00000100:00100000:2.0:1788360788.642039:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143969536 00000100:00100000:2.0:1788360788.642071:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788360788.642077:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005a1e3d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232143969536:12345-0@lo:38: 00010000:00080000:2.0:1788360788.642132:0:5799:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1788360788.642169:0:5799:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf6a94c97d661000a 00000004:00100000:2.0:1788360788.642230:0:5799:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788360788.642350:0:5799:0:(import.c:65:import_set_state_nolock()) 00000000a0a5cc11 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788360788.642412:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005a1e3d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232143969536:12345-0@lo:38: Request processed in 334us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360788.642419:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788360788.642469:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000057ff5c63 x1875232143969536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788360798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788360788.642485:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788360788.642492:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788360788.642496:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788360788.642498:0:3310:0:(import.c:65:import_set_state_nolock()) 0000000030a2e342 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788360788.642503:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000057ff5c63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232143969536:0@lo:38: 00000100:00100000:3.0:1788360788.642654:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000007d770d6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143969408:0@lo:400: 00000100:00100000:3.0:1788360788.642702:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360788.643364:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143969408 00000100:00100000:2.0:1788360788.643369:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143969408 00000100:00100000:2.0:1788360788.643412:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788360788.643420:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec3e4ba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:3313:x1875232143969408:12345-0@lo:400: 00000100:00100000:2.0:1788360788.645919:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec3e4ba6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:3313:x1875232143969408:12345-0@lo:400: Request processed in 2493us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360788.645949:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788360788.648235:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000007d770d6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143969408:0@lo:400: 00010000:00010000:3.0:1788360788.704713:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788360789.154570:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788360789.154577:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8a83778000 from 3 10000000:01000000:1.0:1788360789.154582:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788360789.154647:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 000000007e7fc3bb/0xf6a94c97d6610011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360789.158349:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 000000007e7fc3bb/0xf6a94c97d6610011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360789.158364:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 000000007e7fc3bb/0xf6a94c97d6610011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360789.158472:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000000dd9ce5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143969664:0@lo:101: 00000100:00100000:1.0:1788360789.158545:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360789.158630:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set 00000000ddd66520 going to sleep for 11 seconds 00000100:00100000:0.0:1788360789.160018:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143969664 00000100:00100000:0.0:1788360789.160031:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143969664 00000100:00100000:0.0:1788360789.160123:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788360789.160131:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bff3a617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:5794:x1875232143969664:12345-0@lo:101: 00010000:00010000:0.0:1788360789.160148:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360789.160165:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f7bdf367/0xf6a94c97d6610018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360789.160190:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7bdf367/0xf6a94c97d6610018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610011 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360789.160201:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f7bdf367/0xf6a94c97d6610018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610011 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360789.160208:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f7bdf367, rc 0) 00000100:00100000:0.0:1788360789.160293:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bff3a617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5794:x1875232143969664:12345-0@lo:101: Request processed in 163us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360789.160299:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788360789.163752:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000000dd9ce5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143969664:0@lo:101: 00010000:00010000:1.0:1788360789.163781:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 000000007e7fc3bb/0xf6a94c97d6610011 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360789.163792:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 000000007e7fc3bb/0xf6a94c97d6610011 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360789.163870:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000000dd9ce5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143969792:0@lo:256: 00000100:00100000:1.0:1788360789.163940:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360789.163986:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set 00000000ddd66520 going to sleep for 11 seconds 00000100:00100000:0.0:1788360789.166482:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143969792 00000100:00100000:0.0:1788360789.166494:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143969792 00000100:00100000:0.0:1788360789.166556:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788360789.166565:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000858590a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5794:x1875232143969792:12345-0@lo:256: 20000000:01000000:0.0:1788360789.166591:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788360789.166607:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788360789.166610:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788360789.166748:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000858590a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5794:x1875232143969792:12345-0@lo:256: Request processed in 185us (2809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360789.166756:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788360789.166817:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000000dd9ce5d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143969792:0@lo:256: 10000000:01000000:0.0:1788360789.166872:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788360789.166881:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 000000007e7fc3bb/0xf6a94c97d6610011 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360789.166892:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 000000007e7fc3bb/0xf6a94c97d6610011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360789.728780:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788360790.590380:0:6275:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef1197af0 20000000:00000080:1.0:1788360790.590403:0:6275:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8a90b77000 uarg=0000000000000000 20000000:01000000:1.0:1788360790.590453:0:6275:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788360790.590463:0:6275:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788360790.590469:0:6275:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788360790.591029:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788360790.591042:0:6275:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788360790.595897:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788360790.597080:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788360790.597203:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788360790.597284:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788360790.597316:0:6275:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788360790.597334:0:6275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360790.597357:0:6275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007cb15f1f/0xf6a94c97d660ffe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ffd9 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360790.597364:0:6275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360790.597414:0:6275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007cb15f1f/0xf6a94c97d660ffe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d660ffd9 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360790.597445:0:6275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007cb15f1f/0xf6a94c97d660ffe0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d660ffd9 expref: 11 pid: 5791 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360790.597458:0:6275:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000049692068 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1875232143969920:0@lo:104: 00000100:00100000:1.0:1788360790.597535:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360790.597608:0:6275:0:(client.c:2705:ptlrpc_set_wait()) set 00000000269d0e42 going to sleep for 11 seconds 00000100:00100000:2.0:1788360790.597995:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143969920 00000100:00100000:2.0:1788360790.598003:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143969920 00000100:00100000:2.0:1788360790.598070:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788360790.598078:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb723714 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:6275:x1875232143969920:12345-0@lo:104: 00010000:00010000:2.0:1788360790.598121:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360790.598197:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788360790.598203:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb723714 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:6275:x1875232143969920:12345-0@lo:104: Request processed in 127us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360790.598209:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788360790.598237:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360790.598243:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360790.598257:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009d6b492c already unused, calling callback (0000000068c85d4b) 10000000:00010000:2.0:1788360790.598260:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360790.598268:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360790.598275:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360790.598286:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788360790.598323:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360790.598339:0:6275:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000049692068 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1875232143969920:0@lo:104: 00010000:00010000:2.0:1788360790.598346:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360790.598363:0:6275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360790.598374:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360790.598381:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: 000000009d6b492c/0xf6a94c97d660ffd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ffe0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360790.598404:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360790.598406:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360790.598407:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360790.598425:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000f2350a12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143970048:0@lo:103: 00000100:00100000:2.0:1788360790.598460:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360790.598677:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143970048 00000100:00100000:3.0:1788360790.598682:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143970048 00010000:00010000:3.0:1788360790.598703:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007cb15f1f/0xf6a94c97d660ffe0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d660ffd9 expref: 12 pid: 5791 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360790.598742:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788360790.598749:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087e2b0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:3314:x1875232143970048:12345-0@lo:103: 00010000:00010000:3.0:1788360790.598759:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360790.598764:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007cb15f1f/0xf6a94c97d660ffe0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d660ffd9 expref: 12 pid: 5791 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598773:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007cb15f1f/0xf6a94c97d660ffe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d660ffd9 expref: 12 pid: 5791 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598787:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007cb15f1f/0xf6a94c97d660ffe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d660ffd9 expref: 12 pid: 5791 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598813:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598820:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598845:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598850:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598856:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598861:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598866:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000074ccb72f already unused, calling callback (00000000793830d7) 00010000:00010000:3.0:1788360790.598869:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598875:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598894:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360790.598904:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788360790.598944:0:6275:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360790.598946:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087e2b0f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:3314:x1875232143970048:12345-0@lo:103: Request processed in 197us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360790.598959:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788360790.598960:0:6275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360790.598968:0:6275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074ccb72f/0xf6a94c97d661001f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360790.599949:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000f2350a12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143970048:0@lo:103: 00010000:00010000:0.0:1788360790.753800:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360791.779599:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360792.803472:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360793.765534:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000b33f3d05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143970176:0@lo:400: 00000100:00100000:1.0:1788360793.765600:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360793.765651:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788360793.765656:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000b507fec6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232143970304:0@lo:400: 00000100:00100000:1.0:1788360793.765685:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360793.765717:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143970176 00000100:00100000:1.0:1788360793.765725:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143970176 00000100:00100000:1.0:1788360793.765779:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788360793.765787:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d34d6bf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:3311:x1875232143970176:12345-0@lo:400: 00000100:00100000:1.0:1788360793.765832:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d34d6bf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:3311:x1875232143970176:12345-0@lo:400: Request processed in 46us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360793.765840:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788360793.765871:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143970304 00000100:00100000:1.0:1788360793.765874:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143970304 00000100:00100000:1.0:1788360793.765896:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788360793.765901:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7f1a86d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232143970304:12345-0@lo:400: 00000100:00100000:1.0:1788360793.765929:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7f1a86d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232143970304:12345-0@lo:400: Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360793.765934:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788360793.765973:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b507fec6 x1875232143970304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360793.765987:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000b507fec6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232143970304:0@lo:400: 00000100:00100000:1.0:1788360793.765995:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000b33f3d05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143970176:0@lo:400: 00010000:00010000:2.0:1788360793.824590:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360794.848375:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788360794.865926:0:6590:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788360794.865930:0:6590:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788360794.866174:0:6590:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000b034eaaf 00000020:01000004:1.0:1788360794.866191:0:6590:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788360794.866202:0:6590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788360794.866214:0:6590:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000270e7597) 00000020:00000080:1.0:1788360794.866230:0:6590:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788360794.879371:0:6590:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788360794.879604:0:6590:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788360794.896404:0:6590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788360794.900908:0:6590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788360794.900945:0:6590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788360794.901000:0:6590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788360794.901026:0:6590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788360794.901523:0:6590:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788360794.901533:0:6590:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788360794.901544:0:6590:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d661002d 00000020:01000004:2.0:1788360794.901551:0:6590:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788360794.901571:0:6590:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788360794.901575:0:6590:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788360794.901585:0:6590:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788360794.901589:0:6590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788360794.901607:0:6590:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000006caf0f69) 00000020:00000080:2.0:1788360794.901619:0:6590:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788360794.902909:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788360794.903073:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788360794.903079:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788360794.903672:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788360794.903679:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788360794.903955:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788360794.903962:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788360794.907289:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360794.907442:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788360794.907455:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788360794.910627:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788360794.910642:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788360794.932012:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360794.932378:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788360794.932385:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788360794.934945:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788360794.934961:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788360794.935860:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788360794.935869:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788360794.940455:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788360794.940640:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788360794.940647:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788360794.941396:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788360794.941403:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788360794.992549:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788360794.992728:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788360794.992734:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788360794.994629:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788360794.994641:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788360794.995077:0:6590:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788360794.995128:0:6590:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788360794.995135:0:6590:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788360795.011508:0:6590:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788360795.011544:0:6590:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788360795.011547:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788360795.011549:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788360795.011550:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788360795.011551:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788360795.011552:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788360795.011553:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788360795.011554:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788360795.011556:0:6590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788360795.011557:0:6590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788360795.011558:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788360795.011560:0:6590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788360795.011563:0:6590:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788360795.011565:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788360795.011566:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788360795.011568:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788360795.011568:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788360795.011569:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788360795.011570:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788360795.011575:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788360795.011576:0:6590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788360795.011577:0:6590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788360795.011577:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788360795.011578:0:6590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788360795.011600:0:6590:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788360795.011616:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000519b6c7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143970432:0@lo:253: 00000100:00100000:3.0:1788360795.011685:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360795.011828:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 00000000a1c52756 going to sleep for 11 seconds 00000100:00100000:2.0:1788360795.011934:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143970432 00000100:00100000:2.0:1788360795.011942:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143970432 00000100:00100000:2.0:1788360795.012034:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788360795.012043:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8d8e2e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143970432:12345-0@lo:253: 20000000:01000000:2.0:1788360795.012075:0:5791:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788360795.012079:0:5791:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788360795.012109:0:5791:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788360795.012112:0:5791:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788360795.013058:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788360795.013326:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788360795.013338:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788360795.013370:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788360795.013376:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788360795.013397:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788360795.013431:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788360795.013706:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788360795.013723:0:5791:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.160@tcp 20000000:01000000:2.0:1788360795.013725:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.160@tcp (null) (null) (null) 00000040:00080000:2.0:1788360795.013759:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788360795.013779:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788360795.013828:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788360795.013854:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.160@tcp (null) (null) 00000040:00080000:2.0:1788360795.013886:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788360795.013895:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788360795.013926:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788360795.014033:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788360795.014674:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788360795.014691:0:5791:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.160@tcp 20000000:01000000:2.0:1788360795.014692:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.160@tcp (null) (null) (null) 00000040:00080000:2.0:1788360795.014727:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788360795.014734:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788360795.014778:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788360795.014786:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.160@tcp (null) (null) 00000040:00080000:2.0:1788360795.014831:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788360795.014839:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788360795.014871:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788360795.014906:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788360795.014920:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788360795.014923:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788360795.014926:0:5791:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788360795.014937:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788360795.014939:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788360795.014970:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788360795.014972:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788360795.015515:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788360795.015769:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788360795.015812:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788360795.015884:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788360795.015897:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788360795.015899:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788360795.020684:0:6606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788360795.020781:0:6606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788360795.020891:0:6606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788360795.021560:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788360795.021597:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788360795.021649:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788360795.021661:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788360795.021670:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788360795.024701:0:6607:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788360795.024798:0:6607:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788360795.024861:0:6607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788360795.025238:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788360795.025284:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788360795.025320:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788360795.025346:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788360795.025348:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788360795.025357:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788360795.025375:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.025394:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ce16f992/0xf6a94c97d660ff62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ff5b expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.025401:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000006e29336/0xf6a94c97d660ff7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ff77 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.025407:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000252c7b8d/0xf6a94c97d660ffee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d660ffe7 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.025414:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.025455:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000252c7b8d/0xf6a94c97d660ffee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d660ffe7 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.025469:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000252c7b8d/0xf6a94c97d660ffee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d660ffe7 expref: 11 pid: 5789 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360795.025482:0:5791:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000f2350a12 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5791:1875232143970560:0@lo:104: 00000100:00100000:2.0:1788360795.025544:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788360795.025658:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000006e29336/0xf6a94c97d660ff7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d660ff77 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.025678:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000006e29336/0xf6a94c97d660ff7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d660ff77 expref: 11 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360795.025687:0:5791:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000080887a6e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5791:1875232143970688:0@lo:104: 00000100:00100000:2.0:1788360795.025710:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788360795.026376:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ce16f992/0xf6a94c97d660ff62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d660ff5b expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.026386:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ce16f992/0xf6a94c97d660ff62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d660ff5b expref: 11 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360795.026394:0:5791:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000eb1a9fb0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5791:1875232143970816:0@lo:104: 00000100:00100000:2.0:1788360795.026418:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360795.026572:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143970560 00000100:00100000:0.0:1788360795.026579:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143970560 00000100:00100000:0.0:1788360795.026615:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143970688 00000100:00100000:0.0:1788360795.026618:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143970688 00000100:00100000:0.0:1788360795.026632:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788360795.026659:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033e40dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:5791:x1875232143970560:12345-0@lo:104: 00010000:00010000:0.0:1788360795.026671:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.026759:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788360795.026773:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033e40dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:5791:x1875232143970560:12345-0@lo:104: Request processed in 116us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360795.026780:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788360795.026796:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788360795.026801:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068652476 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5791:x1875232143970688:12345-0@lo:104: 00010000:00010000:0.0:1788360795.026857:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360795.026982:0:5791:0:(client.c:2705:ptlrpc_set_wait()) set 0000000050fab12f going to sleep for 11 seconds 00000100:00100000:2.0:1788360795.027004:0:5791:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000f2350a12 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5791:1875232143970560:0@lo:104: 00000100:00100000:2.0:1788360795.027013:0:5791:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000080887a6e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5791:1875232143970688:0@lo:104: 00000100:00100000:1.0:1788360795.027050:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143970816 00000100:00100000:1.0:1788360795.027054:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143970816 00010000:00010000:3.0:1788360795.027123:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788360795.027130:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027137:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009f7eabc5 already unused, calling callback (0000000068c85d4b) 10000000:00010000:3.0:1788360795.027140:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027148:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360795.027154:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360795.027159:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788360795.027191:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027198:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360795.027214:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027232:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: 000000009f7eabc5/0xf6a94c97d660ffe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ffee expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027246:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788360795.027248:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027253:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000093817166 already unused, calling callback (0000000068c85d4b) 10000000:00010000:3.0:1788360795.027256:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027261:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360795.027267:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360795.027271:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788360795.027283:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027289:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360795.027293:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027298:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d660ff77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ff7e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027308:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360795.027314:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360795.027316:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360795.027495:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000eec60b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143970944:0@lo:103: 00000100:00100000:2.0:1788360795.027528:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360795.027590:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000014c3f0b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143971072:0@lo:103: 00000100:00100000:3.0:1788360795.027615:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360795.027642:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143970944 00000100:00100000:3.0:1788360795.027646:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143970944 00010000:00010000:3.0:1788360795.027664:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000252c7b8d/0xf6a94c97d660ffee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d660ffe7 expref: 12 pid: 5789 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360795.027691:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143971072 00000100:00100000:3.0:1788360795.027694:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143971072 00010000:00010000:3.0:1788360795.027704:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000006e29336/0xf6a94c97d660ff7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d660ff77 expref: 13 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360795.027716:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788360795.027721:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039fb1fa7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3313:x1875232143970944:12345-0@lo:103: 00010000:00010000:3.0:1788360795.027731:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360795.027735:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000252c7b8d/0xf6a94c97d660ffee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d660ffe7 expref: 13 pid: 5789 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027743:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000252c7b8d/0xf6a94c97d660ffee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d660ffe7 expref: 13 pid: 5789 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027755:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000252c7b8d/0xf6a94c97d660ffee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d660ffe7 expref: 13 pid: 5789 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.027777:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360795.027963:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039fb1fa7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:3313:x1875232143970944:12345-0@lo:103: Request processed in 84us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360795.027971:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788360795.027994:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788360795.027999:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e24308ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:3314:x1875232143971072:12345-0@lo:103: 00010000:00010000:3.0:1788360795.028007:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360795.028010:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000006e29336/0xf6a94c97d660ff7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d660ff77 expref: 11 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.028018:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000006e29336/0xf6a94c97d660ff7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d660ff77 expref: 11 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.028026:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000006e29336/0xf6a94c97d660ff7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d660ff77 expref: 11 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.028035:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360795.028061:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e24308ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:3314:x1875232143971072:12345-0@lo:103: Request processed in 62us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360795.028067:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788360795.028125:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000eec60b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143970944:0@lo:103: 00000100:00100000:3.0:1788360795.028149:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000014c3f0b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143971072:0@lo:103: 00010000:00010000:0.0:1788360795.028310:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788360795.028316:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068652476 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:5791:x1875232143970688:12345-0@lo:104: Request processed in 1515us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360795.028323:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788360795.028400:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788360795.028408:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f598535 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5791:x1875232143970816:12345-0@lo:104: 00010000:00010000:0.0:1788360795.028416:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360795.028519:0:5791:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000eb1a9fb0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5791:1875232143970816:0@lo:104: 00010000:00010000:2.0:1788360795.028540:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.028578:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788360795.028583:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.028590:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005db28f9a already unused, calling callback (0000000068c85d4b) 10000000:00010000:1.0:1788360795.028592:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.028607:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788360795.028612:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360795.028616:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788360795.028683:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.028690:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788360795.028712:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.028719:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: 000000005db28f9a/0xf6a94c97d660ff5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d660ff62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.028734:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360795.028736:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360795.028737:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360795.028743:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788360795.028752:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000b33f3d05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143971200:0@lo:103: 00000100:00100000:1.0:1788360795.028790:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360795.028834:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143971200 00000100:00100000:1.0:1788360795.028839:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143971200 00010000:00010000:1.0:1788360795.028855:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ce16f992/0xf6a94c97d660ff62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d660ff5b expref: 10 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360795.028873:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788360795.028985:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b507fec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:3312:x1875232143971200:12345-0@lo:103: 00010000:00010000:1.0:1788360795.029002:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360795.029006:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ce16f992/0xf6a94c97d660ff62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d660ff5b expref: 10 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029015:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ce16f992/0xf6a94c97d660ff62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d660ff5b expref: 10 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029026:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce16f992/0xf6a94c97d660ff62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d660ff5b expref: 10 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029037:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029044:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029056:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029062:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029067:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029073:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029078:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ca96f50a already unused, calling callback (00000000793830d7) 00010000:00010000:1.0:1788360795.029080:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029123:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029136:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029145:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360795.029174:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b507fec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:3312:x1875232143971200:12345-0@lo:103: Request processed in 296us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.029181:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788360795.029208:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000b33f3d05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143971200:0@lo:103: 00010000:00010000:1.0:1788360795.029223:0:5791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029229:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.029235:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ca96f50a/0xf6a94c97d661003b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788360795.029246:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1788360795.029638:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788360795.029645:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f598535 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5791:x1875232143970816:12345-0@lo:104: Request processed in 1239us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360795.029652:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788360795.033307:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360795.064787:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8d8e2e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+8:6590:x1875232143970432:12345-0@lo:253: Request processed in 52739us (53094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.064803:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788360795.064907:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000519b6c7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143970432:0@lo:253: 10000000:01000000:3.0:1788360795.064923:0:6590:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788360795.064926:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788360795.064927:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788360795.064929:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788360795.064930:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788360795.064931:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788360795.064932:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788360795.064934:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788360795.064935:0:6590:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788360795.064937:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788360795.064953:0:6590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788360795.064975:0:6590:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b034eaaf from lustre-OST0000 10000000:01000000:3.0:1788360795.065000:0:6590:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788360795.065003:0:6590:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788360795.065010:0:6590:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8a85713380 local copy 10000000:01000000:3.0:1788360795.065014:0:6590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788360795.065273:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.065284:0:6590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.065292:0:6590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360795.065308:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000519b6c7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143971328:0@lo:101: 00000100:00100000:3.0:1788360795.065344:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360795.065482:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 00000000eae0ad5b going to sleep for 11 seconds 00000100:00100000:1.0:1788360795.065620:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143971328 00000100:00100000:1.0:1788360795.065627:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143971328 00000100:00100000:1.0:1788360795.065778:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788360795.065787:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c2be30f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+8:6590:x1875232143971328:12345-0@lo:101: 00010000:00010000:1.0:1788360795.065810:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360795.065823:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000330d0c11/0xf6a94c97d6610049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610042 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.065846:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000330d0c11/0xf6a94c97d6610049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610042 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.065856:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000330d0c11/0xf6a94c97d6610049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610042 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.065864:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000330d0c11, rc 0) 00000100:00100000:1.0:1788360795.065948:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c2be30f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:6590:x1875232143971328:12345-0@lo:101: Request processed in 162us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.065954:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788360795.066210:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000519b6c7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143971328:0@lo:101: 00010000:00010000:0.0:1788360795.066230:0:6590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.066239:0:6590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360795.066335:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000026f2c8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143971456:0@lo:501: 00000100:00100000:0.0:1788360795.066362:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360795.066486:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 00000000e06a44ee going to sleep for 11 seconds 00000100:00100000:1.0:1788360795.066591:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143971456 00000100:00100000:1.0:1788360795.066595:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143971456 00000100:00100000:1.0:1788360795.066662:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788360795.066669:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000973e481e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:6590:x1875232143971456:12345-0@lo:501: 00000100:00100000:1.0:1788360795.066878:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000973e481e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:6590:x1875232143971456:12345-0@lo:501: Request processed in 210us (515us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788360795.066885:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788360795.066941:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000026f2c8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143971456:0@lo:501: 10000000:01000000:0.0:1788360795.066954:0:6590:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788360795.066979:0:6590:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788360795.066984:0:6590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.066991:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.066998:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.067015:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788360795.067499:0:6590:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8a86b49000 10000000:01000000:0.0:1788360795.067506:0:6590:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788360795.067512:0:6590:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a8a85713380 10000000:01000000:0.0:1788360795.067515:0:6590:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788360795.067518:0:6590:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a8a85713380 from 1 10000000:01000000:0.0:1788360795.067520:0:6590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788360795.067542:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d6610050 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.067557:0:6590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d6610050 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.067565:0:6590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d6610050 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360795.067580:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000026f2c8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143971584:0@lo:101: 00000100:00100000:0.0:1788360795.067611:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360795.067848:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 0000000053a5fee4 going to sleep for 11 seconds 00000100:00100000:3.0:1788360795.067920:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143971584 00000100:00100000:3.0:1788360795.067927:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143971584 00000100:00100000:3.0:1788360795.067954:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788360795.067960:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000657c8f44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+9:6590:x1875232143971584:12345-0@lo:101: 00010000:00010000:3.0:1788360795.067969:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360795.067981:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ffe4b9c/0xf6a94c97d6610057 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610050 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.067997:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ffe4b9c/0xf6a94c97d6610057 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610050 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.068007:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ffe4b9c/0xf6a94c97d6610057 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610050 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.068040:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ffe4b9c, rc 0) 00000100:00100000:3.0:1788360795.068082:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000657c8f44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:6590:x1875232143971584:12345-0@lo:101: Request processed in 122us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360795.068103:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788360795.068183:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000026f2c8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143971584:0@lo:101: 00010000:00010000:0.0:1788360795.068194:0:6590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d6610050 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610057 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.068201:0:6590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d6610050 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610057 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360795.068216:0:6590:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788360795.068232:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d6610050 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610057 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.068239:0:6590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 0000000093817166/0xf6a94c97d6610050 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610057 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360795.068245:0:6590:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788360795.068248:0:6590:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788360795.068252:0:6590:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788360795.068253:0:6590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788360795.068264:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 000000009c5ae777/0xf6a94c97d661005e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.068275:0:6590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 000000009c5ae777/0xf6a94c97d661005e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.068281:0:6590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 000000009c5ae777/0xf6a94c97d661005e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360795.068291:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000026f2c8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143971712:0@lo:101: 00000100:00100000:0.0:1788360795.068313:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360795.068327:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 0000000053a5fee4 going to sleep for 11 seconds 00000100:00100000:3.0:1788360795.068377:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143971712 00000100:00100000:3.0:1788360795.068388:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143971712 00000100:00100000:3.0:1788360795.068404:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788360795.068409:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b55dfbf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:6590:x1875232143971712:12345-0@lo:101: 00010000:00010000:3.0:1788360795.068415:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360795.068421:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042689c93/0xf6a94c97d6610065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661005e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.068433:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042689c93/0xf6a94c97d6610065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661005e expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.068440:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042689c93/0xf6a94c97d6610065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661005e expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.068446:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042689c93, rc 0) 00000100:00100000:3.0:1788360795.068480:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b55dfbf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143971712:12345-0@lo:101: Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360795.068486:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788360795.068587:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788360795.068593:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.068602:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000006e29336 already unused, calling callback (0000000068c85d4b) 10000000:00010000:1.0:1788360795.068606:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360795.068609:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000026f2c8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143971712:0@lo:101: 00010000:00010000:0.0:1788360795.068622:0:6590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 000000009c5ae777/0xf6a94c97d661005e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.068636:0:6590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 000000009c5ae777/0xf6a94c97d661005e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.068637:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360795.068727:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000026f2c8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143971840:0@lo:501: 00000100:00100000:0.0:1788360795.068751:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360795.068768:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 0000000053a5fee4 going to sleep for 11 seconds 00000100:00100000:3.0:1788360795.068862:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143971840 00000100:00100000:3.0:1788360795.068867:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143971840 00000100:00100000:3.0:1788360795.068896:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788360795.068902:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afbfe6ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143971840:12345-0@lo:501: 10000000:00010000:1.0:1788360795.069055:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360795.069062:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788360795.069132:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afbfe6ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143971840:12345-0@lo:501: Request processed in 230us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360795.069143:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1788360795.069154:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.069161:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788360795.069175:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.069179:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: 0000000006e29336/0xf6a94c97d6610042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf6a94c97d6610049 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360795.069194:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000b33f3d05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143971968:0@lo:103: 00010000:00010000:1.0:1788360795.069200:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360795.069202:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360795.069203:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360795.069224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360795.069270:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143971968 00000100:00100000:1.0:1788360795.069274:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143971968 00000100:00100000:1.0:1788360795.069305:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788360795.069309:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014c3f0b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:3312:x1875232143971968:12345-0@lo:103: 00010000:00010000:1.0:1788360795.069322:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360795.069330:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000330d0c11/0xf6a94c97d6610049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6610042 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.069338:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360795.069399:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000026f2c8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143971840:0@lo:501: 00000100:00100000:0.0:1788360795.069424:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000026f2c8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972096:0@lo:503: 00000100:00100000:0.0:1788360795.069459:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360795.069473:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 0000000053a5fee4 going to sleep for 11 seconds 00000100:00100000:1.0:1788360795.069492:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014c3f0b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:3312:x1875232143971968:12345-0@lo:103: Request processed in 181us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.069505:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788360795.069664:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000b33f3d05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143971968:0@lo:103: 00000100:00100000:3.0:1788360795.069680:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143972096 00000100:00100000:3.0:1788360795.069692:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143972096 00000100:00100000:3.0:1788360795.069714:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788360795.069719:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014e3324a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:6590:x1875232143972096:12345-0@lo:503: 00000100:00100000:3.0:1788360795.069873:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014e3324a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:6590:x1875232143972096:12345-0@lo:503: Request processed in 153us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360795.069879:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788360795.070062:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000026f2c8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972096:0@lo:503: 00000040:00080000:1.0:1788360795.070354:0:6590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788360795.070638:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000002e7cf26b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972224:0@lo:502: 00000100:00100000:1.0:1788360795.070679:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360795.070773:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 000000006e850fd8 going to sleep for 11 seconds 00000100:00100000:0.0:1788360795.070820:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143972224 00000100:00100000:0.0:1788360795.070825:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143972224 00000100:00100000:0.0:1788360795.070859:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788360795.070871:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e32ab57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:6590:x1875232143972224:12345-0@lo:502: 00000100:00100000:0.0:1788360795.071015:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e32ab57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:6590:x1875232143972224:12345-0@lo:502: Request processed in 144us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360795.071022:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788360795.071341:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000002e7cf26b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972224:0@lo:502: 00000040:00080000:1.0:1788360795.071945:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788360795.072009:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788360795.072201:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788360795.072259:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788360795.072295:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788360795.072330:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788360795.072361:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000002e7cf26b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972352:0@lo:502: 00000100:00100000:1.0:1788360795.072519:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360795.072595:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 000000006e850fd8 going to sleep for 11 seconds 00000100:00100000:2.0:1788360795.072653:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143972352 00000100:00100000:2.0:1788360795.072659:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143972352 00000100:00100000:0.0:1788360795.072770:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788360795.072779:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001eff91e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:6590:x1875232143972352:12345-0@lo:502: 00000100:00100000:0.0:1788360795.072979:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001eff91e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:6590:x1875232143972352:12345-0@lo:502: Request processed in 202us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360795.072987:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788360795.073268:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000002e7cf26b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972352:0@lo:502: 00000040:00080000:1.0:1788360795.073365:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788360795.073376:0:6590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788360795.073943:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788360795.073951:0:6608:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788360795.073957:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788360795.073966:0:6608:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788360795.073972:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788360795.073984:0:6608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000004279f588) 00000020:00000080:2.0:1788360795.074004:0:6608:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788360795.074010:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788360795.074404:0:6608:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b034eaaf from lustre-OST0000, refs=2 00080000:01000000:2.0:1788360795.074411:0:6608:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788360795.074418:0:6608:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d6610073 00010000:00010000:2.0:1788360795.079305:0:6608:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788360795.079667:0:6608:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788360795.084520:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788360795.084889:0:6608:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788360795.097951:0:6608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788360795.098916:0:6608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788360795.101030:0:6608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788360795.101043:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360795.101049:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360795.101052:0:6608:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788360795.101055:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788360795.101060:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360795.101062:0:6608:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788360795.101066:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788360795.101068:0:6608:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788360795.101153:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360795.101156:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360795.101157:0:6608:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788360795.101160:0:6608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788360795.101874:0:6590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788360795.101901:0:6590:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788360795.101952:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 000000009c5ae777/0xf6a94c97d661005e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.101964:0:6590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 000000009c5ae777/0xf6a94c97d661005e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360795.101985:0:6590:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a86b49000 from 1 10000000:01000000:1.0:1788360795.101988:0:6590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788360795.102023:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 00000000330d0c11/0xf6a94c97d661007a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.102030:0:6590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 00000000330d0c11/0xf6a94c97d661007a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.102040:0:6590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 00000000330d0c11/0xf6a94c97d661007a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360795.102061:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000002e7cf26b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972480:0@lo:101: 00000100:00100000:1.0:1788360795.102150:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360795.102198:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 000000006e850fd8 going to sleep for 11 seconds 00000100:00100000:0.0:1788360795.102262:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143972480 00000100:00100000:0.0:1788360795.102280:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143972480 00000100:00100000:0.0:1788360795.102324:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788360795.102332:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000882c7dbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+10:6590:x1875232143972480:12345-0@lo:101: 00010000:00010000:0.0:1788360795.102345:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360795.102358:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e860d59f/0xf6a94c97d6610081 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661007a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.102389:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e860d59f/0xf6a94c97d6610081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661007a expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.102399:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e860d59f/0xf6a94c97d6610081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661007a expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.102406:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e860d59f, rc 0) 00000100:00100000:0.0:1788360795.102443:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000882c7dbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143972480:12345-0@lo:101: Request processed in 113us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360795.102449:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788360795.102664:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000002e7cf26b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972480:0@lo:101: 00010000:00010000:1.0:1788360795.102678:0:6590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 00000000330d0c11/0xf6a94c97d661007a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.102685:0:6590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 00000000330d0c11/0xf6a94c97d661007a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360795.102776:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000002e7cf26b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972608:0@lo:501: 00000100:00100000:1.0:1788360795.102804:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360795.102859:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 000000006e850fd8 going to sleep for 11 seconds 00000100:00100000:0.0:1788360795.103043:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143972608 00000100:00100000:0.0:1788360795.103047:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143972608 00000100:00100000:0.0:1788360795.103080:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788360795.103253:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001963e45d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143972608:12345-0@lo:501: 00000100:00100000:0.0:1788360795.103635:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001963e45d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143972608:12345-0@lo:501: Request processed in 383us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360795.103643:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788360795.103814:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000002e7cf26b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972608:0@lo:501: 00000100:00100000:1.0:1788360795.103849:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@000000002e7cf26b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972736:0@lo:503: 00000100:00100000:1.0:1788360795.103902:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360795.103964:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 000000006e850fd8 going to sleep for 11 seconds 00000100:00100000:0.0:1788360795.104044:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143972736 00000100:00100000:0.0:1788360795.104049:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143972736 00000100:00100000:0.0:1788360795.104082:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788360795.104108:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000582a7986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143972736:12345-0@lo:503: 00000100:00100000:1.0:1788360795.107757:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000582a7986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143972736:12345-0@lo:503: Request processed in 3642us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.107782:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788360795.110618:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@000000002e7cf26b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972736:0@lo:503: 00000040:00080000:0.0:1788360795.111287:0:6590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788360795.111362:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@0000000050dd8f4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972864:0@lo:502: 00000100:00100000:0.0:1788360795.111510:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360795.111561:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 00000000e06a44ee going to sleep for 11 seconds 00000100:00100000:1.0:1788360795.111571:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143972864 00000100:00100000:1.0:1788360795.111580:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143972864 00000100:00100000:1.0:1788360795.111637:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788360795.111645:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5e1adf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143972864:12345-0@lo:502: 00000100:00100000:1.0:1788360795.112002:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5e1adf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143972864:12345-0@lo:502: Request processed in 358us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.112010:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788360795.112132:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@0000000050dd8f4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972864:0@lo:502: 00000040:00080000:2.0:1788360795.112616:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788360795.112820:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788360795.112854:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@00000000eb1a9fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972992:0@lo:502: 00000100:00100000:2.0:1788360795.112899:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360795.112937:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set 0000000072b7f4f0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360795.113065:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143972992 00000100:00100000:1.0:1788360795.113071:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143972992 00000100:00100000:1.0:1788360795.113128:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788360795.113136:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d02294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143972992:12345-0@lo:502: 00000100:00100000:1.0:1788360795.113560:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d02294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143972992:12345-0@lo:502: Request processed in 425us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.113567:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788360795.114349:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@00000000eb1a9fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143972992:0@lo:502: 00000040:00080000:2.0:1788360795.114748:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788360795.114772:0:6590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788360795.115461:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788360795.115542:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360795.115545:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788360795.115552:0:6612:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a86b49000 00000020:00000080:0.0:1788360795.115555:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788360795.115597:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360795.115601:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360795.115603:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788360795.115605:0:6612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788360795.115855:0:6590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788360795.115874:0:6590:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788360795.115926:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d661007a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.115938:0:6590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d661007a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360795.115982:0:6590:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788360795.115985:0:6590:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a86b49000 10000000:01000000:2.0:1788360795.115989:0:6590:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a86b49000 10000000:01000000:2.0:1788360795.116001:0:6590:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788360795.116007:0:6590:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a86b49000 from 1 10000000:01000000:2.0:1788360795.116010:0:6590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788360795.116044:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.116052:0:6590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.116062:0:6590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360795.116121:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143973120:0@lo:101: 00000100:00100000:2.0:1788360795.116180:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360795.116210:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788360795.116267:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143973120 00000100:00100000:1.0:1788360795.116285:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143973120 00000100:00100000:1.0:1788360795.116322:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788360795.116330:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143973120:12345-0@lo:101: 00010000:00010000:1.0:1788360795.116344:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360795.116356:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d661008f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610088 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.116378:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d661008f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610088 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.116395:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d661008f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610088 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.116404:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813cb800, rc 0) 00000100:00100000:1.0:1788360795.116452:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6590:x1875232143973120:12345-0@lo:101: Request processed in 123us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.116459:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788360795.116823:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143973120:0@lo:101: 00010000:00010000:2.0:1788360795.116837:0:6590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.116846:0:6590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360795.116941:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143973248:0@lo:501: 00000100:00100000:2.0:1788360795.116968:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360795.116991:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788360795.117040:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143973248 00000100:00100000:1.0:1788360795.117045:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143973248 00000100:00100000:1.0:1788360795.117108:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788360795.117115:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6590:x1875232143973248:12345-0@lo:501: 00000100:00100000:1.0:1788360795.117462:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6590:x1875232143973248:12345-0@lo:501: Request processed in 346us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.117540:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788360795.117608:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143973248:0@lo:501: 00000100:00100000:2.0:1788360795.117771:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143973376:0@lo:503: 00000100:00100000:2.0:1788360795.117812:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360795.117846:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788360795.117886:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143973376 00000100:00100000:0.0:1788360795.117890:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143973376 00000100:00100000:0.0:1788360795.117925:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788360795.117933:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6590:x1875232143973376:12345-0@lo:503: 00000100:00100000:0.0:1788360795.118110:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6590:x1875232143973376:12345-0@lo:503: Request processed in 177us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360795.118117:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788360795.118196:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143973376:0@lo:503: 00000040:00080000:2.0:1788360795.118615:0:6590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788360795.118921:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143973504:0@lo:502: 00000100:00100000:2.0:1788360795.118959:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360795.118991:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788360795.119392:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143973504 00000100:00100000:1.0:1788360795.119398:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143973504 00000100:00100000:1.0:1788360795.119435:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788360795.119442:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6590:x1875232143973504:12345-0@lo:502: 00000100:00100000:1.0:1788360795.119950:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6590:x1875232143973504:12345-0@lo:502: Request processed in 506us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.119958:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788360795.120028:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143973504:0@lo:502: 00000040:00080000:2.0:1788360795.120577:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788360795.120643:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788360795.120689:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788360795.120736:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788360795.120788:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788360795.120838:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788360795.120877:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788360795.120913:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788360795.120960:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788360795.120993:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788360795.121019:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788360795.121063:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788360795.121144:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788360795.121180:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788360795.121226:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788360795.121261:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788360795.121323:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788360795.121384:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788360795.121420:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788360795.121453:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788360795.121501:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788360795.121536:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788360795.121579:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788360795.121640:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788360795.121684:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788360795.121717:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788360795.121774:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788360795.121811:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788360795.121854:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143973632:0@lo:502: 00000100:00100000:2.0:1788360795.121922:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360795.121953:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788360795.122543:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143973632 00000100:00100000:1.0:1788360795.122552:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143973632 00000100:00100000:1.0:1788360795.122598:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788360795.122606:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6590:x1875232143973632:12345-0@lo:502: 00000100:00100000:1.0:1788360795.122838:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6590:x1875232143973632:12345-0@lo:502: Request processed in 232us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.122852:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788360795.123113:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143973632:0@lo:502: 00000040:00080000:2.0:1788360795.123198:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788360795.123209:0:6590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788360795.124144:0:6613:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788360795.124166:0:6613:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a8985368000) 00000020:00000080:3.0:1788360795.124186:0:6613:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788360795.124448:0:6613:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a86b49000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788360795.124452:0:6613:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a86b49000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788360795.124454:0:6613:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a86b49000 3 00010000:00080000:3.0:1788360795.124492:0:6613:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a86758000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788360795.126215:0:6613:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788360795.126319:0:6613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788360795.126353:0:6613:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788360795.126365:0:6613:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf6a94c97d661009d 00000100:00080000:3.0:1788360795.126376:0:6613:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788360795.126388:0:6613:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8a86758000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788360795.126424:0:6613:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a84938a80 x1875232143973760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788360795.126449:0:6613:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788360795.126610:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788360795.126626:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232143973888:0@lo:400: 00000100:00100000:1.0:1788360795.126693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360795.126740:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143973888 00000100:00100000:1.0:1788360795.126746:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143973888 00000100:00100000:1.0:1788360795.126796:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788360795.126805:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232143973888:12345-0@lo:400: 00000100:00100000:1.0:1788360795.126855:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232143973888:12345-0@lo:400: Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.126863:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788360795.126912:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8a83543100 x1875232143973888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360795.126924:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232143973888:0@lo:400: 00000040:00080000:1.0:1788360795.127274:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1788360795.127499:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232143973760:0@lo:38: 00000100:00100000:2.0:1788360795.127547:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788360795.127599:0:6590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788360795.127624:0:6590:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788360795.127640:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.127651:0:6590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788360795.127704:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788360795.127707:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788360795.127708:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360795.127709:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788360795.127710:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360795.127712:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360795.127713:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788360795.127715:0:6590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788360795.127716:0:6590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788360795.127717:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360795.127719:0:6590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788360795.127722:0:6590:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788360795.127729:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788360795.127730:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788360795.127731:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360795.127732:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788360795.127732:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360795.127733:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360795.127734:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788360795.127735:0:6590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788360795.127736:0:6590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788360795.127737:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360795.127738:0:6590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788360795.127754:0:6590:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788360795.127776:0:6590:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143974016:0@lo:253: 00000100:00100000:2.0:1788360795.127808:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360795.127822:0:6590:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360795.128017:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143973760 00000100:00100000:1.0:1788360795.128022:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143973760 00000100:00100000:1.0:1788360795.128052:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788360795.128057:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232143973760:12345-0@lo:38: 00010000:00080000:1.0:1788360795.128077:0:5797:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1788360795.128125:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf6a94c97d66100a4 00000004:00100000:1.0:1788360795.128139:0:5797:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788360795.128168:0:5797:0:(import.c:65:import_set_state_nolock()) ffff9a8ab6fb8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788360795.128216:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875232143973760:12345-0@lo:38: Request processed in 157us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.128223:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788360795.128250:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143974016 00000100:00100000:1.0:1788360795.128253:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143974016 00000100:00100000:1.0:1788360795.128290:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788360795.128296:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6590:x1875232143974016:12345-0@lo:253: 20000000:01000000:1.0:1788360795.128317:0:5791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788360795.128329:0:5791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1788360795.129178:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8a84938a80 x1875232143973760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788360805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360795.129190:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788360795.129197:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788360795.129205:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788360795.129210:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788360795.129213:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a86758000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788360795.129219:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232143973760:0@lo:38: 20000000:01000000:1.0:1788360795.173793:0:5791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788360795.173811:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788360795.173905:0:5813:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788360795.173911:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788360795.173952:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.173970:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a80031c00/0xf6a94c97d6610018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610011 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.173979:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.174021:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a80031c00/0xf6a94c97d6610018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6610011 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.174048:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a80031c00/0xf6a94c97d6610018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6610011 expref: 12 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360795.174074:0:5813:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1875232143974144:0@lo:104: 00000100:00100000:0.0:1788360795.174155:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360795.174212:0:5813:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360795.174448:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143974144 00000100:00100000:2.0:1788360795.174458:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143974144 00000100:00100000:2.0:1788360795.174508:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788360795.174517:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5813:x1875232143974144:12345-0@lo:104: 00010000:00010000:2.0:1788360795.174530:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb400/0xf6a94c97d6610011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360795.174588:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788360795.174594:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5813:x1875232143974144:12345-0@lo:104: Request processed in 78us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360795.174600:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788360795.174684:0:5813:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1875232143974144:0@lo:104: 00010000:00010000:1.0:1788360795.174702:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.174800:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788360795.174807:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb400/0xf6a94c97d6610011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.174815:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a813cb400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360795.174819:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb400/0xf6a94c97d6610011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.174827:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb400/0xf6a94c97d6610011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360795.174834:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb400/0xf6a94c97d6610011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360795.174839:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788360795.174874:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb400/0xf6a94c97d6610011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.174881:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360795.174898:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb400/0xf6a94c97d6610011 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.174906:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb400/0xf6a94c97d6610011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610018 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360795.174921:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360795.174929:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360795.174931:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360795.174938:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788360795.174950:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143974272:0@lo:103: 00000100:00100000:3.0:1788360795.174983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360795.175044:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143974272 00000100:00100000:0.0:1788360795.175049:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143974272 00010000:00010000:0.0:1788360795.175069:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a80031c00/0xf6a94c97d6610018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610011 expref: 13 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360795.175110:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788360795.175118:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84eda450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3313:x1875232143974272:12345-0@lo:103: 00010000:00010000:0.0:1788360795.175128:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360795.175133:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a80031c00/0xf6a94c97d6610018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610011 expref: 13 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175143:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a80031c00/0xf6a94c97d6610018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6610011 expref: 13 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175156:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a80031c00/0xf6a94c97d6610018 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6610011 expref: 13 pid: 5791 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175169:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175176:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788360795.175189:0:5784:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004028956s 00010000:00010000:0.0:1788360795.175193:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175209:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175216:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175223:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175228:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586b600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788360795.175231:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175239:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175260:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360795.175377:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360795.175406:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84eda450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:3313:x1875232143974272:12345-0@lo:103: Request processed in 289us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360795.175412:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788360795.175493:0:5813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360795.175494:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143974272:0@lo:103: 00010000:00010000:1.0:1788360795.175611:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360795.175618:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586b600/0xf6a94c97d66100ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360795.184156:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:6590:x1875232143974016:12345-0@lo:253: Request processed in 55849us (56336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360795.184171:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788360795.184204:0:6590:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:6590:1875232143974016:0@lo:253: 10000000:01000000:2.0:1788360795.184221:0:6590:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788360795.184225:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788360795.184227:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788360795.184228:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360795.184229:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788360795.184231:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360795.184249:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360795.184251:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788360795.184255:0:6590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788360795.184257:0:6590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788360795.184258:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360795.184260:0:6590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788360795.184280:0:6590:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788360795.191070:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788360795.191310:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788360795.191499:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788360795.191656:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788360795.191860:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788360795.192159:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788360795.198834:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788360795.399696:0:6590:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788360795.399706:0:6590:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788360795.399739:0:6590:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788360795.399807:0:6590:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788360795.399823:0:6590:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788360795.399853:0:6590:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788360795.882375:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360796.897457:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788360796.960144:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788360796.960153:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a83778000 from 21 10000000:01000000:1.0:1788360796.960158:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788360796.960201:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360796.960215:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360796.960227:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360796.960253:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143974400:0@lo:101: 00000100:00100000:1.0:1788360796.960322:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360796.960378:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788360796.961484:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143974400 00000100:00100000:3.0:1788360796.961494:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143974400 00000100:00100000:3.0:1788360796.961541:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788360796.961551:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:5794:x1875232143974400:12345-0@lo:101: 00010000:00010000:3.0:1788360796.961566:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360796.961581:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66100b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66100b2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360796.961606:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66100b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66100b2 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360796.961616:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66100b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66100b2 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360796.961625:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fa00, rc 0) 00000100:00100000:3.0:1788360796.961678:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5794:x1875232143974400:12345-0@lo:101: Request processed in 129us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360796.961691:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788360796.961798:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143974400:0@lo:101: 00010000:00010000:1.0:1788360796.961815:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360796.961834:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360796.961889:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143974528:0@lo:501: 00000100:00100000:1.0:1788360796.961916:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360796.961947:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788360796.961998:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143974528 00000100:00100000:3.0:1788360796.962004:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143974528 00000100:00100000:3.0:1788360796.962036:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788360796.962043:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5794:x1875232143974528:12345-0@lo:501: 00000100:00100000:3.0:1788360796.962399:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5794:x1875232143974528:12345-0@lo:501: Request processed in 355us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360796.962406:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788360796.962646:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143974528:0@lo:501: 00000100:00100000:1.0:1788360796.962676:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143974656:0@lo:503: 00000100:00100000:1.0:1788360796.962714:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360796.962745:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788360796.964649:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143974656 00000100:00100000:3.0:1788360796.964662:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143974656 00000100:00100000:3.0:1788360796.964716:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788360796.964725:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5794:x1875232143974656:12345-0@lo:503: 00000100:00100000:3.0:1788360796.965155:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5794:x1875232143974656:12345-0@lo:503: Request processed in 430us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360796.965163:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788360796.965360:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143974656:0@lo:503: 00000100:00100000:1.0:1788360796.966019:0:6723:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6723:1875232143974784:0@lo:502: 00000100:00100000:1.0:1788360796.966082:0:6723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360796.966145:0:6723:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788360796.966209:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143974784 00000100:00100000:3.0:1788360796.966215:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143974784 00000100:00100000:3.0:1788360796.966251:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788360796.966258:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6723:x1875232143974784:12345-0@lo:502: 00000100:00100000:3.0:1788360796.966518:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6723:x1875232143974784:12345-0@lo:502: Request processed in 259us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360796.966525:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788360796.966712:0:6723:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6723:1875232143974784:0@lo:502: 00000100:00100000:1.0:1788360796.966767:0:6723:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6723:1875232143974912:0@lo:502: 00000100:00100000:1.0:1788360796.966800:0:6723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360796.966822:0:6723:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788360796.966869:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143974912 00000100:00100000:3.0:1788360796.966874:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143974912 00000100:00100000:3.0:1788360796.966908:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788360796.966917:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6723:x1875232143974912:12345-0@lo:502: 00000100:00100000:3.0:1788360796.967173:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:6723:x1875232143974912:12345-0@lo:502: Request processed in 257us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360796.967179:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788360796.967259:0:6723:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6723:1875232143974912:0@lo:502: 00000040:00080000:1.0:1788360796.967278:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788360796.967472:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788360796.967489:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788360796.967498:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360796.967510:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360796.967520:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788360796.967523:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8a83778000 from 4 10000000:01000000:3.0:1788360796.967526:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788360796.967551:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360796.967559:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360796.967568:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360796.967582:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143975040:0@lo:101: 00000100:00100000:3.0:1788360796.967611:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360796.967641:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83f11cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360796.967681:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143975040 00000100:00100000:1.0:1788360796.967686:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143975040 00000100:00100000:1.0:1788360796.967719:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788360796.967726:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:5794:x1875232143975040:12345-0@lo:101: 00010000:00010000:1.0:1788360796.967741:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360796.967765:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66100c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66100c0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360796.967786:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66100c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66100c0 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360796.967797:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66100c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66100c0 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360796.967806:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813ca800, rc 0) 00000100:00100000:1.0:1788360796.967838:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143975040:12345-0@lo:101: Request processed in 112us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360796.967844:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788360796.967876:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84938700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143975040:0@lo:101: 00010000:00010000:1.0:1788360796.967887:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360796.967894:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360796.967936:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143975168:0@lo:256: 00000100:00100000:1.0:1788360796.967964:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360796.967978:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788360796.967989:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143975168 00000100:00100000:1.0:1788360796.967992:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143975168 00000100:00100000:1.0:1788360796.968013:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788360796.968018:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143975168:12345-0@lo:256: 20000000:01000000:1.0:1788360796.968657:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788360796.968674:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788360796.968677:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788360796.968872:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143975168:12345-0@lo:256: Request processed in 852us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360796.968881:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788360796.968940:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143975168:0@lo:256: 10000000:01000000:3.0:1788360796.968986:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788360796.968994:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360796.969008:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360796.969016:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788360796.969018:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788360796.969020:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788360796.969187:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360796.969195:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360796.969203:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360796.969216:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143975296:0@lo:101: 00000100:00100000:3.0:1788360796.969245:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360796.969309:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83f11540 going to sleep for 11 seconds 00000100:00100000:1.0:1788360796.969352:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143975296 00000100:00100000:1.0:1788360796.969357:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143975296 00000100:00100000:1.0:1788360796.969517:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788360796.969525:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143975296:12345-0@lo:101: 00010000:00010000:1.0:1788360796.969534:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360796.969547:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d66100d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66100ce expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360796.969565:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d66100d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66100ce expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360796.969585:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d66100d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66100ce expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360796.969593:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813cb600, rc 0) 00000100:00100000:1.0:1788360796.969626:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143975296:12345-0@lo:101: Request processed in 102us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360796.969631:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788360796.970730:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143975296:0@lo:101: 00010000:00010000:3.0:1788360796.970758:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360796.970768:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360796.970826:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143975424:0@lo:501: 00000100:00100000:3.0:1788360796.970865:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360796.970955:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83f11540 going to sleep for 11 seconds 00000100:00100000:1.0:1788360796.973906:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143975424 00000100:00100000:1.0:1788360796.973923:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143975424 00000100:00100000:1.0:1788360796.973977:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788360796.973987:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143975424:12345-0@lo:501: 00000100:00100000:1.0:1788360796.974325:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143975424:12345-0@lo:501: Request processed in 339us (3458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360796.974339:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788360796.974478:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143975424:0@lo:501: 00000100:00100000:0.0:1788360796.974530:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143975552:0@lo:503: 00000100:00100000:0.0:1788360796.974576:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360796.974606:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360796.974620:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143975552 00000100:00100000:0.0:1788360796.974630:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143975552 00000100:00100000:0.0:1788360796.974714:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788360796.974722:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143975552:12345-0@lo:503: 00000100:00100000:0.0:1788360796.975017:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143975552:12345-0@lo:503: Request processed in 294us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360796.975024:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788360796.976120:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143975552:0@lo:503: 00000100:00100000:0.0:1788360796.977284:0:6725:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6725:1875232143975680:0@lo:502: 00000100:00100000:0.0:1788360796.977357:0:6725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360796.977794:0:6725:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360796.977833:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143975680 00000100:00100000:1.0:1788360796.977840:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143975680 00000100:00100000:2.0:1788360796.978761:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788360796.978774:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:6725:x1875232143975680:12345-0@lo:502: 00000100:00100000:2.0:1788360796.979156:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:6725:x1875232143975680:12345-0@lo:502: Request processed in 383us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360796.979165:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788360796.979178:0:6725:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6725:1875232143975680:0@lo:502: 00000020:01000000:0.0:1788360796.979214:0:6725:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788360796.979223:0:6725:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788360796.979230:0:6725:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360796.979232:0:6725:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788360796.979242:0:6725:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788360796.979246:0:6725:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:0.0:1788360796.979269:0:6725:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788360796.979272:0:6725:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788360796.979300:0:6725:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a8a90bf3380) 00000020:00000080:0.0:1788360796.979320:0:6725:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788360796.979329:0:6725:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788360796.979667:0:6725:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788360796.979674:0:6725:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788360796.979682:0:6725:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66100e3 00010000:00080000:0.0:1788360796.979714:0:6725:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8abc48c800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788360796.981799:0:6725:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788360797.031970:0:6725:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788360797.031993:0:6725:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788360797.032555:0:6725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788360797.033081:0:6725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788360797.033169:0:6725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788360797.033229:0:6725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788360797.035068:0:6734:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788360797.035075:0:6734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788360797.037373:0:6725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788360797.037388:0:6725:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788360797.037429:0:6725:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788360797.037450:0:6725:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66100ea 00000100:00080000:0.0:1788360797.037467:0:6725:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788360797.037473:0:6725:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8abc48c800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788360797.037515:0:6725:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ab7799880 x1875232143975808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788360797.037542:0:6725:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788360797.037599:0:6725:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360797.037604:0:6725:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360797.037605:0:6725:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788360797.037609:0:6725:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788360797.037612:0:6725:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360797.037614:0:6725:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788360797.037616:0:6725:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788360797.037619:0:6725:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788360797.037643:0:6725:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7798380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6725:1875232143975936:0@lo:502: 00000100:00100000:0.0:1788360797.037717:0:6725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360797.037768:0:6725:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788360797.037792:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143975936 00000100:00100000:0.0:1788360797.037798:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143975936 00000100:00100000:0.0:1788360797.037836:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788360797.037846:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:6725:x1875232143975936:12345-0@lo:502: 00000100:00100000:0.0:1788360797.038154:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:6725:x1875232143975936:12345-0@lo:502: Request processed in 309us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360797.038162:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788360797.038225:0:6725:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7798380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6725:1875232143975936:0@lo:502: 00000020:01000000:0.0:1788360797.038248:0:6725:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360797.038253:0:6725:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360797.038255:0:6725:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788360797.038259:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1788360797.038594:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232143975808:0@lo:8: 00000100:00100000:1.0:1788360797.038632:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360797.038706:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232143976064:0@lo:400: 00000100:00100000:1.0:1788360797.038731:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360797.038768:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788360797.038774:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232143976192:0@lo:400: 00000100:00100000:1.0:1788360797.038795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360797.038824:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143976064 00000100:00100000:1.0:1788360797.038828:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143976064 00000100:00100000:1.0:1788360797.038858:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143976192 00000100:00100000:1.0:1788360797.038861:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143976192 00000100:00100000:1.0:1788360797.038884:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788360797.038891:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232143976064:12345-0@lo:400: 00000100:00100000:0.0:1788360797.039074:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788360797.039112:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788360797.039158:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232143976064:12345-0@lo:400: Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360797.039167:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788360797.039184:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788360797.039191:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232143976192:12345-0@lo:400: 00000100:00100000:1.0:1788360797.039229:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232143976192:12345-0@lo:400: Request processed in 38us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360797.039235:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788360797.039256:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788360797.039359:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a83543800 x1875232143976192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360797.039372:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232143976192:0@lo:400: 00010000:00080000:1.0:1788360797.039386:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a83540000 x1875232143976064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360797.039394:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232143976064:0@lo:400: 00000020:01000000:2.0:1788360797.042421:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788360797.042452:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788360797.042463:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.042476:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360797.042486:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788360797.042489:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a83778000 from 1 10000000:01000000:2.0:1788360797.042491:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788360797.042528:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.042536:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.042559:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360797.042582:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143976320:0@lo:101: 00000100:00100000:2.0:1788360797.042663:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360797.042712:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360797.042743:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143976320 00000100:00100000:2.0:1788360797.042745:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143975808 00000100:00100000:3.0:1788360797.042760:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143976320 00000100:00100000:2.0:1788360797.042764:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143975808 00000100:00100000:2.0:1788360797.042803:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788360797.042811:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232143975808:12345-0@lo:8: 00010000:00080000:2.0:1788360797.042846:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000100:00100000:3.0:1788360797.042876:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000020:00000080:2.0:1788360797.042881:0:6592:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66100f8 00000100:00100000:3.0:1788360797.042889:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143976320:12345-0@lo:101: 00010000:00010000:3.0:1788360797.042903:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360797.042917:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d66100ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66100f1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1788360797.042921:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a8985349800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788360797.042930:0:6592:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788360797.042934:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1788360797.042947:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d66100ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66100f1 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360797.042959:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d66100ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66100f1 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360797.042969:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e400, rc 0) 00000100:00100000:3.0:1788360797.043016:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143976320:12345-0@lo:101: Request processed in 131us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360797.043024:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00002000:00100000:2.0:1788360797.043403:0:6592:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788360797.043570:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788360797.043597:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a898534f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788360797.043770:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232143975808:12345-0@lo:8: Request processed in 957us (5135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360797.043779:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788360797.043827:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143976320:0@lo:101: 00010000:00080000:3.0:1788360797.043881:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab7799880 x1875232143975808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788360807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360797.043892:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788360797.043899:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788360797.043914:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788360797.043919:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788360797.043922:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788360797.043938:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788360797.043943:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232143975808:0@lo:8: 00010000:00010000:2.0:1788360797.043969:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.043986:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360797.044155:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143976448:0@lo:501: 00000100:00100000:2.0:1788360797.044191:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360797.044220:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360797.044238:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143976448 00000100:00100000:2.0:1788360797.044243:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143976448 00000100:00100000:2.0:1788360797.044275:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788360797.044284:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a867e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143976448:12345-0@lo:501: 00000100:00100000:2.0:1788360797.044534:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a867e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143976448:12345-0@lo:501: Request processed in 251us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360797.044541:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788360797.044579:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143976448:0@lo:501: 00000100:00100000:2.0:1788360797.044612:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143976576:0@lo:503: 00000100:00100000:2.0:1788360797.044756:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360797.044773:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360797.044789:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143976576 00000100:00100000:2.0:1788360797.044793:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143976576 00000004:00080000:3.0:1788360797.044798:0:6734:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788360797.044818:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788360797.044825:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a867e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143976576:12345-0@lo:503: 00000004:00080000:3.0:1788360797.045181:0:6734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 187060094322ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788360797.049321:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a867e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143976576:12345-0@lo:503: Request processed in 4484us (4563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360797.049336:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788360797.049557:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143976576:0@lo:503: 00000100:00100000:2.0:1788360797.049896:0:6738:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6738:1875232143976704:0@lo:502: 00000100:00100000:2.0:1788360797.049952:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360797.049997:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143976704 00000100:00100000:2.0:1788360797.050004:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143976704 00000100:00100000:2.0:1788360797.050059:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788360797.050069:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:6738:x1875232143976704:12345-0@lo:502: 00000100:00100000:2.0:1788360797.050356:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:6738:x1875232143976704:12345-0@lo:502: Request processed in 287us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360797.050365:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788360797.050438:0:6738:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788360797.050457:0:6738:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6738:1875232143976704:0@lo:502: 00000020:01000000:2.0:1788360797.050489:0:6738:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788360797.050498:0:6738:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788360797.050501:0:6738:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788360797.050510:0:6738:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a83778000 00000020:00000080:2.0:1788360797.050512:0:6738:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788360797.050537:0:6738:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6738:1875232143976832:0@lo:502: 00000100:00100000:2.0:1788360797.050577:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360797.050605:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143976832 00000100:00100000:2.0:1788360797.050610:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143976832 00000100:00100000:2.0:1788360797.050644:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788360797.050654:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:6738:x1875232143976832:12345-0@lo:502: 00000100:00100000:2.0:1788360797.050854:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:6738:x1875232143976832:12345-0@lo:502: Request processed in 201us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360797.050863:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788360797.050908:0:6738:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788360797.050925:0:6738:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:6738:1875232143976832:0@lo:502: 00000020:01000000:2.0:1788360797.050951:0:6738:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788360797.050956:0:6738:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788360797.050958:0:6738:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788360797.050967:0:6738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788360797.051037:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788360797.051062:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788360797.051072:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.051109:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360797.051119:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788360797.051122:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a8a85713380 from 1 10000000:01000000:2.0:1788360797.051126:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788360797.051152:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.051161:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.051170:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360797.051184:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143976960:0@lo:101: 00000100:00100000:2.0:1788360797.051218:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360797.051258:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788360797.051278:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143976960 00000100:00100000:2.0:1788360797.051283:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143976960 00000100:00100000:2.0:1788360797.051314:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788360797.051324:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143976960:12345-0@lo:101: 00010000:00010000:2.0:1788360797.051333:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360797.051348:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d661010d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610106 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.051382:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d661010d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610106 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.051394:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d661010d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610106 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.051403:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45000, rc 0) 00000100:00100000:2.0:1788360797.051443:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143976960:12345-0@lo:101: Request processed in 120us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360797.051451:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788360797.051497:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143976960:0@lo:101: 00010000:00010000:2.0:1788360797.051512:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.051521:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360797.051566:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143977088:0@lo:501: 00000100:00100000:2.0:1788360797.051598:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360797.051618:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788360797.051636:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143977088 00000100:00100000:2.0:1788360797.051640:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143977088 00000100:00100000:2.0:1788360797.051673:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788360797.051684:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143977088:12345-0@lo:501: 00000100:00100000:2.0:1788360797.051911:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143977088:12345-0@lo:501: Request processed in 230us (314us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788360797.051919:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788360797.051960:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143977088:0@lo:501: 10000000:01000000:2.0:1788360797.051987:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788360797.051993:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360797.052001:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788360797.099856:0:6735:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788360797.099945:0:6735:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1875232143977344:0@lo:7: 00000100:00100000:3.0:1788360797.100012:0:6735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360797.100024:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788360797.100044:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232143977216:0@lo:13: 00000100:00100000:1.0:1788360797.100105:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360797.100129:0:6735:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788360797.100154:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143977216 00000100:00100000:1.0:1788360797.100163:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143977216 00000100:00100000:1.0:1788360797.100231:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788360797.100242:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232143977216:12345-0@lo:13: 00000100:00080000:3.0:1788360797.100249:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788360797.100272:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788360797.100323:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232143977216:12345-0@lo:13: Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360797.100330:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788360797.100387:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a8493b100 x1875232143977216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360797.100407:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232143977216:0@lo:13: 00000100:00100000:2.0:1788360797.100472:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143977344 00000100:00100000:2.0:1788360797.100477:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143977344 00000100:00100000:2.0:1788360797.100546:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788360797.100556:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6735:x1875232143977344:12345-0@lo:7: 00002000:00080000:2.0:1788360797.107366:0:6594:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788360797.107374:0:6594:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788360797.107488:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6735:x1875232143977344:12345-0@lo:7: Request processed in 6929us (7472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360797.107500:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788360797.107574:0:6735:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a8493b480 x1875232143977344/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788360813 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360797.107589:0:6735:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1875232143977344:0@lo:7: 00000004:00080000:3.0:1788360797.107603:0:6735:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788360797.107642:0:6735:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1875232143977472:0@lo:5: 00000100:00100000:3.0:1788360797.107677:0:6735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360797.107714:0:6735:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788360797.107971:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143977472 00000100:00100000:2.0:1788360797.107977:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143977472 00000100:00100000:2.0:1788360797.108019:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788360797.108028:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6735:x1875232143977472:12345-0@lo:5: 00002000:00080000:2.0:1788360797.108054:0:6592:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788360797.108058:0:6592:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788360797.108301:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6735:x1875232143977472:12345-0@lo:5: Request processed in 274us (623us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788360797.108309:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788360797.108829:0:6735:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a8493b480 x1875232143977472/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788360813 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360797.108843:0:6735:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1875232143977472:0@lo:5: 00000004:00080000:0.0:1788360797.108854:0:6735:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788360797.108884:0:6735:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7798380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1875232143977600:0@lo:700: 00000100:00100000:0.0:1788360797.108914:0:6735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360797.108933:0:6735:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a880ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1788360797.108951:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143977600 00000100:00100000:0.0:1788360797.108955:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143977600 00000100:00100000:0.0:1788360797.108978:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788360797.108984:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6735:x1875232143977600:12345-0@lo:700: 00000100:00100000:0.0:1788360797.109009:0:6601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6601:1875232143977728:0@lo:700: 00000100:00100000:0.0:1788360797.109036:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360797.109051:0:6601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788360797.109071:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143977728 00000100:00100000:0.0:1788360797.109074:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143977728 00000100:00100000:0.0:1788360797.109118:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788360797.109125:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6601:x1875232143977728:12345-0@lo:700: 00000004:00080000:2.0:1788360797.130641:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1788360797.160897:0:5804:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788360797.169413:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6601:x1875232143977728:12345-0@lo:700: Request processed in 60280us (60368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360797.169428:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788360797.169695:0:6601:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab779a680 x1875232143977728/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788360813 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360797.169733:0:6601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6601:1875232143977728:0@lo:700: 40000000:02000000:2.0:1788360797.169757:0:6601:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1788360797.245634:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6735:x1875232143977600:12345-0@lo:700: Request processed in 136641us (136710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360797.245669:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788360797.245724:0:6735:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab7798380 x1875232143977600/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788360813 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360797.245741:0:6735:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7798380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1875232143977600:0@lo:700: 00000001:00080000:3.0:1788360797.247185:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788360797.247202:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1788360797.275119:0:6735:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788360797.279030:0:6735:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1875232143977856:0@lo:5: 00000100:00100000:1.0:1788360797.279151:0:6735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360797.279203:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143977856 00000100:00100000:1.0:1788360797.279211:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143977856 00000100:00100000:1.0:1788360797.279258:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788360797.279267:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6735:x1875232143977856:12345-0@lo:5: 00000100:00100000:2.0:1788360797.282440:0:6735:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7cc0 going to sleep for 11 seconds 00002000:00080000:1.0:1788360797.294272:0:6594:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788360797.294295:0:6594:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788360797.300404:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6735:x1875232143977856:12345-0@lo:5: Request processed in 21128us (21243us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788360797.300416:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788360797.300823:0:6735:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a83543800 x1875232143977856/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788360813 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360797.300837:0:6735:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788360797.300852:0:6735:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8a83543800 x1875232143977856/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788360813 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360797.300862:0:6735:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1875232143977856:0@lo:5: 00000004:00080000:2.0:1788360797.300877:0:6735:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788360797.921227:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360798.947728:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360799.973914:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788360800.243651:0:6962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788360800.992245:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360802.016668:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360802.464473:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788360802.464498:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232143977984:0@lo:13: 00000100:00100000:2.0:1788360802.464562:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360802.464625:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143977984 00000100:00100000:2.0:1788360802.464633:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143977984 00000100:00080000:3.0:1788360802.464683:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788360802.464683:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788360802.464692:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232143977984:12345-0@lo:13: 00002000:00000024:2.0:1788360802.464734:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788360802.464783:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232143977984:12345-0@lo:13: Request processed in 93us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360802.464790:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788360802.464867:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8abc431f80 x1875232143977984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360802.464887:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232143977984:0@lo:13: 00000100:00100000:2.0:1788360802.464981:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232143978240:0@lo:400: 00000100:00100000:2.0:1788360802.465010:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360802.465041:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232143978368:0@lo:400: 00000100:00100000:2.0:1788360802.465044:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788360802.465049:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143978112:0@lo:400: 00000100:00100000:0.0:1788360802.465070:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360802.465071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360802.465118:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143978240 00000100:00100000:2.0:1788360802.465123:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143978240 00000100:00100000:0.0:1788360802.465128:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143978368 00000100:00100000:0.0:1788360802.465137:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143978368 00000100:00100000:2.0:1788360802.465149:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788360802.465155:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232143978240:12345-0@lo:400: 00000100:00100000:0.0:1788360802.465162:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788360802.465167:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232143978368:12345-0@lo:400: 00000100:00100000:2.0:1788360802.465190:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232143978240:12345-0@lo:400: Request processed in 35us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360802.465194:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232143978368:12345-0@lo:400: Request processed in 28us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360802.465197:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788360802.465199:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788360802.465210:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360802.465213:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143978112 00000100:00100000:2.0:1788360802.465216:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143978112 00010000:00080000:0.0:1788360802.465225:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8abc431c00 x1875232143978368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360802.465235:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232143978368:0@lo:400: 00000100:00100000:2.0:1788360802.465236:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788360802.465242:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:3312:x1875232143978112:12345-0@lo:400: 00000100:00100000:2.0:1788360802.465271:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:3312:x1875232143978112:12345-0@lo:400: Request processed in 29us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360802.465277:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788360802.465306:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143978112:0@lo:400: 00010000:00080000:2.0:1788360802.465329:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8abc431180 x1875232143978240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360802.465338:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232143978240:0@lo:400: 00000001:00080000:1.0:1788360802.526428:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788360803.040670:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360804.065491:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360805.091592:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360806.112275:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360807.140469:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360807.587834:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143978496:0@lo:400: 00000100:00100000:0.0:1788360807.587906:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360807.588041:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788360807.588048:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232143978880:0@lo:400: 00000100:00100000:0.0:1788360807.588075:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360807.588130:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232143978624:0@lo:400: 00000100:00100000:0.0:1788360807.588153:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360807.588172:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788360807.588178:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232143978752:0@lo:400: 00000100:00100000:0.0:1788360807.588270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360807.588303:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143978496 00000100:00100000:0.0:1788360807.588310:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143978496 00000100:00100000:0.0:1788360807.588354:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788360807.588364:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:3314:x1875232143978496:12345-0@lo:400: 00000100:00100000:0.0:1788360807.588412:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:3314:x1875232143978496:12345-0@lo:400: Request processed in 50us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360807.588430:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788360807.588464:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143978624 00000100:00100000:0.0:1788360807.588468:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143978624 00000100:00100000:0.0:1788360807.588490:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143978752 00000100:00100000:0.0:1788360807.588493:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143978752 00000100:00100000:0.0:1788360807.588515:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788360807.588521:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232143978624:12345-0@lo:400: 00000100:00100000:0.0:1788360807.588553:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232143978624:12345-0@lo:400: Request processed in 32us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360807.588558:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788360807.588568:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788360807.588573:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232143978752:12345-0@lo:400: 00000100:00100000:0.0:1788360807.588594:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232143978752:12345-0@lo:400: Request processed in 21us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360807.588600:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788360807.588620:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788360807.588646:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab779aa00 x1875232143978752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360807.588658:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232143978752:0@lo:400: 00010000:00080000:0.0:1788360807.588667:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab779bb80 x1875232143978624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360807.588688:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232143978624:0@lo:400: 00000100:00100000:0.0:1788360807.588711:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143978496:0@lo:400: 00000100:00100000:3.0:1788360807.588806:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143978880 00000100:00100000:3.0:1788360807.588810:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143978880 00000100:00100000:3.0:1788360807.588839:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788360807.588846:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232143978880:12345-0@lo:400: 00000100:00100000:3.0:1788360807.588880:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232143978880:12345-0@lo:400: Request processed in 35us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360807.588885:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788360807.588901:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788360807.588914:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab7798700 x1875232143978880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360807.588922:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788360807.588930:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232143978880:0@lo:400: 00000100:00100000:0.0:1788360807.590100:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360807.590117:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232143979008:0@lo:13: 00000100:00100000:0.0:1788360807.590167:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360807.590631:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143979008 00000100:00100000:0.0:1788360807.590639:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143979008 00000100:00100000:0.0:1788360807.590692:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788360807.590700:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232143979008:12345-0@lo:13: 00002000:00000024:0.0:1788360807.590729:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360807.590769:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232143979008:12345-0@lo:13: Request processed in 71us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360807.590776:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788360807.592352:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8abc431180 x1875232143979008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360807.592375:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232143979008:0@lo:13: 00010000:00010000:1.0:1788360808.161200:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788360808.619006:0:7480:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788360808.619010:0:7480:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788360808.619177:0:7480:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a898534c800 00000020:01000004:2.0:1788360808.619193:0:7480:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788360808.619207:0:7480:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788360808.619220:0:7480:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a8ab72499c0) 00000020:00000080:2.0:1788360808.619237:0:7480:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788360808.646362:0:7480:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788360808.646622:0:7480:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788360808.705436:0:7480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788360808.723398:0:7480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788360808.723433:0:7480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788360808.723490:0:7480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788360808.723519:0:7480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788360808.724152:0:7480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788360808.724164:0:7480:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788360808.724174:0:7480:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d661011b 00000020:01000004:3.0:1788360808.724182:0:7480:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788360808.724208:0:7480:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788360808.724211:0:7480:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788360808.724217:0:7480:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788360808.724236:0:7480:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788360808.724240:0:7480:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788360808.762637:0:7480:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788360808.762783:0:7480:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.160@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788360808.762788:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788360808.762790:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788360808.762791:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360808.762792:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788360808.762793:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360808.762795:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360808.762796:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788360808.762798:0:7480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788360808.762799:0:7480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788360808.762801:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360808.762802:0:7480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788360808.762806:0:7480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788360808.762809:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788360808.762810:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788360808.762812:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788360808.762813:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788360808.762814:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788360808.762815:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788360808.762816:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788360808.762817:0:7480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788360808.762818:0:7480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788360808.762819:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788360808.762820:0:7480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788360808.762844:0:7480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788360808.762861:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143979136:0@lo:253: 00000100:00100000:2.0:1788360808.762931:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360808.763062:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85014000 going to sleep for 11 seconds 00000100:00100000:0.0:1788360808.763147:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143979136 00000100:00100000:0.0:1788360808.763156:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143979136 00000100:00100000:0.0:1788360808.763208:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788360808.763218:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:7480:x1875232143979136:12345-0@lo:253: 20000000:01000000:0.0:1788360808.763248:0:5792:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788360808.763252:0:5792:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788360808.763257:0:5792:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788360808.763261:0:5792:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788360808.765424:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788360808.766033:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788360808.766050:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788360808.766644:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788360808.766656:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788360808.766705:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788360808.766764:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788360808.769714:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788360808.769747:0:5792:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.160@tcp 20000000:01000000:0.0:1788360808.769756:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.160@tcp (null) (null) (null) 00000040:00080000:0.0:1788360808.769796:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788360808.769805:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788360808.769871:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788360808.769880:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.160@tcp (null) (null) 00000040:00080000:0.0:1788360808.769927:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788360808.769938:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788360808.769971:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788360808.770023:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788360808.771921:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788360808.771949:0:5792:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.160@tcp 20000000:01000000:1.0:1788360808.771952:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.160@tcp (null) (null) (null) 00000040:00080000:1.0:1788360808.772000:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788360808.772009:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788360808.772055:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788360808.772064:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.160@tcp (null) (null) 00000040:00080000:1.0:1788360808.772113:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788360808.772123:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788360808.772172:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788360808.772212:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788360808.772231:0:5792:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788360808.772244:0:5792:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788360808.772249:0:5792:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788360808.772251:0:5792:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788360808.772253:0:5792:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788360808.772264:0:5792:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788360808.772267:0:5792:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788360808.772497:0:5792:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788360808.772500:0:5792:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788360808.774324:0:7483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788360808.774428:0:7483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788360808.774463:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788360808.774869:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788360808.774914:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788360808.774970:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788360808.774982:0:5792:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788360808.774984:0:5792:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788360808.775721:0:7484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788360808.775768:0:7484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788360808.775937:0:7484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788360808.776200:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788360808.776237:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788360808.776525:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788360808.776539:0:5792:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788360808.776542:0:5792:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788360808.784502:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788360808.790059:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788360808.790137:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788360808.790213:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788360808.790247:0:5792:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788360808.790250:0:5792:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788360808.791585:0:7486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788360808.791653:0:7486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788360808.791722:0:7486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788360808.792627:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788360808.792686:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788360808.792723:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:1.0:1788360808.792741:0:5792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788360808.792758:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.792776:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d6610065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661005e expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.792794:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d661008f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610088 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.792801:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66100b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66100b2 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.792963:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d66100d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66100ce expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.792971:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d661010d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610106 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.792979:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.793017:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d661010d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6610106 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.793032:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d661010d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6610106 expref: 16 pid: 5789 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360808.793047:0:5792:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1875232143979264:0@lo:104: 00000100:00100000:1.0:1788360808.793128:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788360808.793181:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d66100d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66100ce expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.793190:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d66100d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66100ce expref: 16 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360808.793197:0:5792:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1875232143979392:0@lo:104: 00010000:00010000:1.0:1788360808.793222:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66100b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66100b2 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.793230:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66100b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66100b2 expref: 16 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360808.793251:0:5792:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1875232143979520:0@lo:104: 00010000:00010000:1.0:1788360808.793278:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d661008f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6610088 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.793285:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d661008f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6610088 expref: 16 pid: 5789 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360808.793292:0:5792:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1875232143979648:0@lo:104: 00000100:00100000:0.0:1788360808.793422:0:5781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788360808.796593:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.796632:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.796646:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143979264 00000100:00100000:0.0:1788360808.796655:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143979264 00000100:00100000:0.0:1788360808.796703:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143979392 00000100:00100000:0.0:1788360808.796707:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143979392 00000100:00100000:0.0:1788360808.796718:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143979520 00000100:00100000:0.0:1788360808.796720:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143979520 00000100:00100000:0.0:1788360808.796732:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788360808.796739:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:5792:x1875232143979264:12345-0@lo:104: 00010000:00010000:0.0:1788360808.796757:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.796848:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788360808.796855:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:5792:x1875232143979264:12345-0@lo:104: Request processed in 117us (3727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.796863:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788360808.796868:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788360808.796878:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.796888:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360808.796892:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.796900:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.796905:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788360808.796916:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:5792:x1875232143979392:12345-0@lo:104: 10000000:00010000:3.0:1788360808.797016:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360808.797023:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788360808.797038:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.797066:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.797074:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360808.797115:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.797119:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788360808.797128:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:5792:x1875232143979392:12345-0@lo:104: Request processed in 211us (543us total) trans 0 rc 0/0 00010000:00010000:3.0:1788360808.797135:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45200/0xf6a94c97d6610106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661010d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.797140:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788360808.797159:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788360808.797161:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788360808.797165:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.797172:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5792:x1875232143979520:12345-0@lo:104: 00010000:00010000:3.0:1788360808.797175:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360808.797181:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.797183:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.797190:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360808.797199:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360808.797204:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788360808.797219:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788360808.797221:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.797227:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5792:x1875232143979520:12345-0@lo:104: Request processed in 57us (593us total) trans 0 rc 0/0 00010000:00010000:3.0:1788360808.797234:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788360808.797238:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788360808.797243:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.797251:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d66100ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100d5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.797263:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788360808.797266:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143979776:0@lo:103: 00010000:00010000:3.0:1788360808.797274:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.797281:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a813cbc00 already unused, calling callback (ffffffffc1ba5c20) 00000100:00100000:0.0:1788360808.797314:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.797349:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788360808.797355:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143979904:0@lo:103: 00000100:00100000:0.0:1788360808.797376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788360808.797402:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360808.797412:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143979776 00000100:00100000:0.0:1788360808.797416:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143979776 00010000:00010000:0.0:1788360808.797432:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d661010d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610106 expref: 17 pid: 5789 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.797453:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143979904 00000100:00100000:0.0:1788360808.797455:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143979904 00010000:00010000:0.0:1788360808.797465:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d66100d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66100ce expref: 18 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.797485:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788360808.797491:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:3311:x1875232143979776:12345-0@lo:103: 00010000:00010000:0.0:1788360808.797501:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360808.797506:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d661010d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610106 expref: 18 pid: 5789 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.797516:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d661010d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6610106 expref: 18 pid: 5789 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.797531:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360808.797556:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:3311:x1875232143979776:12345-0@lo:103: Request processed in 66us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.797562:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788360808.797573:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788360808.797578:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:3311:x1875232143979904:12345-0@lo:103: 00010000:00010000:0.0:1788360808.797584:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360808.797588:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d66100d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66100ce expref: 17 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.797595:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d66100d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66100ce expref: 17 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.797604:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360808.797624:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:3311:x1875232143979904:12345-0@lo:103: Request processed in 46us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.797629:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788360808.797678:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143979904:0@lo:103: 00000100:00100000:0.0:1788360808.797699:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143979776:0@lo:103: 10000000:00010000:3.0:1788360808.798387:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.798399:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360808.798405:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360808.798410:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788360808.799131:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.799140:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788360808.799171:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.799178:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d66100b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100b9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360808.799194:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143980032:0@lo:103: 00010000:00010000:0.0:1788360808.799195:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360808.799199:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360808.799203:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360808.799251:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.799402:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143980032 00000100:00100000:0.0:1788360808.799409:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143980032 00010000:00010000:0.0:1788360808.799434:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66100b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66100b2 expref: 17 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.799470:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788360808.799478:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:3313:x1875232143980032:12345-0@lo:103: 00010000:00010000:0.0:1788360808.799490:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360808.799494:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66100b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66100b2 expref: 17 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.799504:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66100b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66100b2 expref: 17 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.799517:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360808.799554:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:3313:x1875232143980032:12345-0@lo:103: Request processed in 76us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.799571:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788360808.799604:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143980032:0@lo:103: 00000100:00100000:1.0:1788360808.800056:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788360808.800284:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d6610065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661005e expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.800296:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d6610065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661005e expref: 16 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360808.800320:0:5792:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1875232143980160:0@lo:104: 00000100:00100000:1.0:1788360808.800346:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360808.800367:0:5792:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788360808.800383:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d661010d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6610106 expref: 16 pid: 5789 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360808.800394:0:5792:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1875232143979264:0@lo:104: 00010000:00010000:1.0:1788360808.800403:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d66100d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66100ce expref: 15 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360808.800410:0:5792:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1875232143979392:0@lo:104: 00010000:00010000:1.0:1788360808.800418:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66100b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66100b2 expref: 14 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360808.800436:0:5792:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1875232143979520:0@lo:104: 00000100:00100000:0.0:1788360808.800533:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143979648 00000100:00100000:0.0:1788360808.800539:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143979648 00000100:00100000:0.0:1788360808.800561:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143980160 00000100:00100000:0.0:1788360808.800564:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143980160 00000100:00100000:0.0:1788360808.800576:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788360808.800582:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:5792:x1875232143979648:12345-0@lo:104: 00010000:00010000:0.0:1788360808.800593:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800650:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788360808.800656:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:5792:x1875232143979648:12345-0@lo:104: Request processed in 75us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.800663:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788360808.800687:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788360808.800694:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5792:x1875232143980160:12345-0@lo:104: 00010000:00010000:0.0:1788360808.800701:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a80031800/0xf6a94c97d661005e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800734:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788360808.800739:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5792:x1875232143980160:12345-0@lo:104: Request processed in 46us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.800744:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788360808.800757:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788360808.800762:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800790:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788360808.800794:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800802:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788360808.800818:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360808.800825:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788360808.800849:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800856:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788360808.800870:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800878:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661008f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800888:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788360808.800892:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a80031800/0xf6a94c97d661005e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800897:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80031800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788360808.800900:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a80031800/0xf6a94c97d661005e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.800901:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360808.800921:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a80031800/0xf6a94c97d661005e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788360808.800926:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a80031800/0xf6a94c97d661005e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360808.800931:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788360808.800945:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a80031800/0xf6a94c97d661005e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800950:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788360808.800972:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a80031800/0xf6a94c97d661005e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800979:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a80031800/0xf6a94c97d661005e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610065 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.800993:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360808.800995:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360808.800996:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360808.801007:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143980288:0@lo:103: 00000100:00100000:0.0:1788360808.801036:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.801065:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143980288 00000100:00100000:0.0:1788360808.801070:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143980288 00010000:00010000:0.0:1788360808.801110:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d661008f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610088 expref: 14 pid: 5789 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360808.801125:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143980416:0@lo:103: 00000100:00100000:0.0:1788360808.801135:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788360808.801143:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:3314:x1875232143980288:12345-0@lo:103: 00000100:00100000:3.0:1788360808.801161:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788360808.801161:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360808.801169:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d661008f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610088 expref: 14 pid: 5789 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801180:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d661008f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6610088 expref: 14 pid: 5789 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801197:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360808.801201:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788360808.801210:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788360808.801455:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d661008f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6610088 expref: 14 pid: 5789 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360808.801466:0:5792:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1875232143979648:0@lo:104: 00000100:00100000:1.0:1788360808.801475:0:5792:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1875232143980160:0@lo:104: 00010000:00010000:1.0:1788360808.801497:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.801544:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3314:x1875232143980288:12345-0@lo:103: Request processed in 401us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.801553:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788360808.801569:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143980416 00000100:00100000:0.0:1788360808.801573:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143980416 00010000:00010000:0.0:1788360808.801585:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d6610065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661005e expref: 13 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.801597:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788360808.801602:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3311:x1875232143980416:12345-0@lo:103: 00010000:00010000:0.0:1788360808.801609:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360808.801613:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d6610065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661005e expref: 13 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801620:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d6610065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661005e expref: 13 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801630:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d6610065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661005e expref: 13 pid: 5792 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801641:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801660:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801682:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801689:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801696:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801702:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801708:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a813cb000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788360808.801712:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801719:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801736:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.801744:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360808.801789:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:3311:x1875232143980416:12345-0@lo:103: Request processed in 186us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.801795:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788360808.801845:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143980416:0@lo:103: 00000100:00100000:0.0:1788360808.801929:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143980288:0@lo:103: 00010000:00010000:1.0:1788360808.802223:0:5792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.802231:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.802238:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d6610122 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788360808.802250:0:5792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788360808.869213:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:7480:x1875232143979136:12345-0@lo:253: Request processed in 105987us (106272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360808.869227:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788360808.869338:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143979136:0@lo:253: 10000000:01000000:3.0:1788360808.869353:0:7480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788360808.869356:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788360808.869358:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788360808.869359:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788360808.869361:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788360808.869362:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788360808.869363:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788360808.869365:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788360808.869367:0:7480:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788360808.869368:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788360808.869382:0:7480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788360808.869400:0:7480:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a898534c800 from lustre-OST0001 10000000:01000000:3.0:1788360808.869424:0:7480:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788360808.869427:0:7480:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788360808.869434:0:7480:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8a85713380 local copy 10000000:01000000:3.0:1788360808.869438:0:7480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788360808.869472:0:7480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.869483:0:7480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.869565:0:7480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360808.869584:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143980544:0@lo:101: 00000100:00100000:3.0:1788360808.869620:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360808.869656:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f903c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360808.869724:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143980544 00000100:00100000:0.0:1788360808.869730:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143980544 00000100:00100000:0.0:1788360808.869767:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788360808.869775:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+11:7480:x1875232143980544:12345-0@lo:101: 00010000:00010000:0.0:1788360808.869787:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360808.869800:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610129 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.869820:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610129 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.869831:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610129 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.869840:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586b400, rc 0) 00000100:00100000:0.0:1788360808.869877:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:7480:x1875232143980544:12345-0@lo:101: Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.869883:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788360808.870051:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143980544:0@lo:101: 00010000:00010000:3.0:1788360808.870064:0:7480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.870072:0:7480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360808.870204:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143980672:0@lo:501: 00000100:00100000:3.0:1788360808.870229:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360808.870257:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360808.870309:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143980672 00000100:00100000:2.0:1788360808.870314:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143980672 00000100:00100000:2.0:1788360808.870336:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788360808.870342:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:7480:x1875232143980672:12345-0@lo:501: 00000100:00100000:2.0:1788360808.870589:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:7480:x1875232143980672:12345-0@lo:501: Request processed in 246us (358us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788360808.870597:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788360808.870682:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143980672:0@lo:501: 10000000:01000000:3.0:1788360808.870695:0:7480:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788360808.870726:0:7480:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788360808.870731:0:7480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.870739:0:7480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.870747:0:7480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.870772:0:7480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788360808.870793:0:7480:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a898534c800 10000000:01000000:3.0:1788360808.870797:0:7480:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788360808.870802:0:7480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788360808.870804:0:7480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788360808.870808:0:7480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788360808.870810:0:7480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788360808.870826:0:7480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.870833:0:7480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.870842:0:7480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360808.870854:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143980800:0@lo:101: 00000100:00100000:3.0:1788360808.870880:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360808.870897:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90780 going to sleep for 11 seconds 00000100:00100000:3.0:1788360808.870911:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143980800 00000100:00100000:3.0:1788360808.870921:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143980800 00000100:00100000:3.0:1788360808.871024:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788360808.871031:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:7480:x1875232143980800:12345-0@lo:101: 00010000:00010000:3.0:1788360808.871039:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360808.871048:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1f200/0xf6a94c97d661013e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610137 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.871064:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1f200/0xf6a94c97d661013e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610137 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.871072:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1f200/0xf6a94c97d661013e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610137 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.871079:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f200, rc 0) 00000100:00100000:3.0:1788360808.871132:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143980800:12345-0@lo:101: Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360808.871139:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788360808.871171:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143980800:0@lo:101: 00010000:00010000:3.0:1788360808.871181:0:7480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.871188:0:7480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360808.871242:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143980928:0@lo:501: 00000100:00100000:3.0:1788360808.871264:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360808.871283:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90780 going to sleep for 11 seconds 00000100:00100000:3.0:1788360808.871296:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143980928 00000100:00100000:3.0:1788360808.871300:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143980928 00000100:00100000:3.0:1788360808.871323:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788360808.871328:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143980928:12345-0@lo:501: 00000100:00100000:3.0:1788360808.871482:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143980928:12345-0@lo:501: Request processed in 152us (215us total) trans 0 rc 0/0 00010000:00010000:2.0:1788360808.871574:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360808.871581:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.871588:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360808.871592:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.871600:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360808.871607:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360808.871620:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788360808.871637:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.871643:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788360808.871659:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.871676:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f600/0xf6a94c97d6610129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf6a94c97d6610130 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.871688:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360808.871690:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360808.871692:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360808.871726:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788360808.871749:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788360808.871759:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143981056:0@lo:103: 00000100:00100000:3.0:1788360808.871784:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360808.871830:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143980928:0@lo:501: 00000100:00100000:3.0:1788360808.871855:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981184:0@lo:503: 00000100:00100000:3.0:1788360808.871890:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360808.871903:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90780 going to sleep for 11 seconds 00000100:00100000:3.0:1788360808.871914:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143981184 00000100:00100000:3.0:1788360808.871917:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143981184 00000100:00100000:2.0:1788360808.872075:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143981056 00000100:00100000:2.0:1788360808.872080:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143981056 00000100:00100000:2.0:1788360808.872139:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788360808.872146:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:3311:x1875232143981056:12345-0@lo:103: 00010000:00010000:2.0:1788360808.872155:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360808.872166:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6610129 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.872176:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360808.872207:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3311:x1875232143981056:12345-0@lo:103: Request processed in 61us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360808.872213:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788360808.872268:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788360808.872276:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:7480:x1875232143981184:12345-0@lo:503: 00000100:00100000:3.0:1788360808.872426:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:7480:x1875232143981184:12345-0@lo:503: Request processed in 151us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360808.872472:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981184:0@lo:503: 00000040:00080000:2.0:1788360808.872755:0:7480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788360808.872815:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc432300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981312:0@lo:502: 00000100:00100000:2.0:1788360808.872853:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360808.872872:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360808.873059:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143981312 00000100:00100000:0.0:1788360808.873064:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143981312 00000100:00100000:0.0:1788360808.873106:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788360808.873113:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981312:12345-0@lo:502: 00000100:00100000:0.0:1788360808.873253:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981312:12345-0@lo:502: Request processed in 140us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.873260:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788360808.873360:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc432300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981312:0@lo:502: 00000040:00080000:2.0:1788360808.873613:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788360808.873659:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788360808.873709:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788360808.873756:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788360808.873790:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788360808.873824:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788360808.873847:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc432300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981440:0@lo:502: 00000100:00100000:2.0:1788360808.873884:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360808.873908:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360808.874070:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143981440 00000100:00100000:0.0:1788360808.874075:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143981440 00000100:00100000:0.0:1788360808.874131:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788360808.874140:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981440:12345-0@lo:502: 00000100:00100000:0.0:1788360808.874291:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981440:12345-0@lo:502: Request processed in 153us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.874299:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788360808.874400:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc432300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981440:0@lo:502: 00000040:00080000:2.0:1788360808.874500:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788360808.874511:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:3.0:1788360808.874931:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:01000000:1.0:1788360808.874994:0:7489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788360808.875003:0:7489:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788360808.875011:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360808.875014:0:7489:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788360808.875020:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788360808.875034:0:7489:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a8a84f13380) 00000100:00100000:3.0:1788360808.875054:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143981056:0@lo:103: 00000020:00000080:1.0:1788360808.875058:0:7489:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788360808.875066:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788360808.875165:0:7489:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a898534c800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788360808.875173:0:7489:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788360808.875215:0:7489:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d661014c 00010000:00010000:1.0:1788360808.878425:0:7489:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788360808.878950:0:7489:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788360808.882619:0:7489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788360808.882922:0:7489:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788360808.887893:0:7489:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788360808.889662:0:7489:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788360808.894687:0:7489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788360808.894701:0:7489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360808.894712:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360808.894714:0:7489:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788360808.894718:0:7489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788360808.894722:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360808.894723:0:7489:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788360808.894726:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788360808.894728:0:7489:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788360808.894786:0:7489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360808.894791:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360808.894792:0:7489:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788360808.894796:0:7489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788360808.895319:0:7480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788360808.895347:0:7480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788360808.895363:0:7480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.895374:0:7480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360808.895382:0:7480:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a898534c800 from 1 10000000:01000000:2.0:1788360808.895385:0:7480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788360808.895418:0:7480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.895442:0:7480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.895452:0:7480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360808.895476:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc432300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981568:0@lo:101: 00000100:00100000:2.0:1788360808.895535:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360808.895571:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190240 going to sleep for 11 seconds 00000100:00100000:1.0:1788360808.895993:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143981568 00000100:00100000:1.0:1788360808.896000:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143981568 00000100:00100000:1.0:1788360808.896055:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788360808.896072:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:7480:x1875232143981568:12345-0@lo:101: 00010000:00010000:1.0:1788360808.896114:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360808.896136:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d661015a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610153 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.896159:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d661015a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610153 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.896169:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d661015a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610153 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.896177:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813cb000, rc 0) 00000100:00100000:1.0:1788360808.896223:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981568:12345-0@lo:101: Request processed in 153us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360808.896229:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788360808.896284:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc432300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981568:0@lo:101: 00010000:00010000:1.0:1788360808.896300:0:7480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.896322:0:7480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360808.896430:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981696:0@lo:501: 00000100:00100000:1.0:1788360808.896467:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360808.896498:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360808.896532:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143981696 00000100:00100000:0.0:1788360808.896538:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143981696 00000100:00100000:0.0:1788360808.896572:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788360808.896579:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981696:12345-0@lo:501: 00000100:00100000:0.0:1788360808.896804:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981696:12345-0@lo:501: Request processed in 225us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.896811:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788360808.897224:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981696:0@lo:501: 00000100:00100000:1.0:1788360808.897256:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981824:0@lo:503: 00000100:00100000:1.0:1788360808.897294:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360808.897318:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360808.897894:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143981824 00000100:00100000:0.0:1788360808.897901:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143981824 00000100:00100000:0.0:1788360808.898327:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788360808.898337:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981824:12345-0@lo:503: 00000100:00100000:0.0:1788360808.898745:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981824:12345-0@lo:503: Request processed in 409us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.898763:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788360808.900733:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981824:0@lo:503: 00000040:00080000:1.0:1788360808.901115:0:7480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788360808.901191:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981952:0@lo:502: 00000100:00100000:1.0:1788360808.901257:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360808.901297:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788360808.902552:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143981952 00000100:00100000:2.0:1788360808.902562:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143981952 00000100:00100000:2.0:1788360808.902616:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788360808.902626:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981952:12345-0@lo:502: 00000100:00100000:2.0:1788360808.902908:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143981952:12345-0@lo:502: Request processed in 283us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360808.902915:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788360808.903044:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143981952:0@lo:502: 00000040:00080000:1.0:1788360808.903425:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788360808.903477:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788360808.903509:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982080:0@lo:502: 00000100:00100000:1.0:1788360808.903550:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360808.903591:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788360808.907744:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143982080 00000100:00100000:2.0:1788360808.907758:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143982080 00000100:00100000:2.0:1788360808.907819:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788360808.907830:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143982080:12345-0@lo:502: 00000100:00100000:2.0:1788360808.908072:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143982080:12345-0@lo:502: Request processed in 243us (4520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360808.908080:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788360808.908214:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982080:0@lo:502: 00000040:00080000:1.0:1788360808.908375:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788360808.908392:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788360808.909678:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788360808.909688:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360808.909691:0:7493:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788360808.909700:0:7493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a898534c800 00000020:00000080:1.0:1788360808.909702:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788360808.909725:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788360808.909729:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360808.909730:0:7493:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788360808.909733:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788360808.909877:0:7480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788360808.909896:0:7480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788360808.909914:0:7480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.913053:0:7480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360808.913145:0:7480:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788360808.913149:0:7480:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a898534c800 10000000:01000000:2.0:1788360808.913152:0:7480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a898534c800 10000000:01000000:2.0:1788360808.913157:0:7480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788360808.913163:0:7480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a898534c800 from 1 10000000:01000000:2.0:1788360808.913166:0:7480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788360808.913202:0:7480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.913211:0:7480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.913222:0:7480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360808.913293:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982208:0@lo:101: 00000100:00100000:3.0:1788360808.913366:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360808.913411:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a880ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788360808.913799:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143982208 00000100:00100000:2.0:1788360808.913806:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143982208 00000100:00100000:2.0:1788360808.913861:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788360808.913870:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143982208:12345-0@lo:101: 00010000:00010000:2.0:1788360808.913883:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360808.913896:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6610168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610161 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.913920:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6610168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610161 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.914174:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6610168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610161 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.914184:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45200, rc 0) 00000100:00100000:2.0:1788360808.914372:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:7480:x1875232143982208:12345-0@lo:101: Request processed in 502us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360808.914379:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788360808.914652:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982208:0@lo:101: 00010000:00010000:3.0:1788360808.914689:0:7480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360808.914708:0:7480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360808.914834:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982336:0@lo:501: 00000100:00100000:3.0:1788360808.914866:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360808.914899:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a880ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788360808.915164:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143982336 00000100:00100000:2.0:1788360808.915170:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143982336 00000100:00100000:2.0:1788360808.915203:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788360808.915269:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:7480:x1875232143982336:12345-0@lo:501: 00000100:00100000:3.0:1788360808.917444:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:7480:x1875232143982336:12345-0@lo:501: Request processed in 2170us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360808.917457:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788360808.917551:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982336:0@lo:501: 00000100:00100000:2.0:1788360808.917607:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982464:0@lo:503: 00000100:00100000:2.0:1788360808.917661:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360808.917707:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49900 going to sleep for 11 seconds 00000100:00100000:1.0:1788360808.917881:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143982464 00000100:00100000:1.0:1788360808.917888:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143982464 00000100:00100000:1.0:1788360808.918047:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788360808.918060:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:7480:x1875232143982464:12345-0@lo:503: 00000100:00100000:1.0:1788360808.918303:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:7480:x1875232143982464:12345-0@lo:503: Request processed in 246us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360808.918310:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788360808.919916:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982464:0@lo:503: 00000040:00080000:3.0:1788360808.920296:0:7480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788360808.920367:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982592:0@lo:502: 00000100:00100000:3.0:1788360808.920764:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360808.920811:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788360808.921421:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143982592 00000100:00100000:1.0:1788360808.921430:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143982592 00000100:00100000:1.0:1788360808.921480:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788360808.921488:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:7480:x1875232143982592:12345-0@lo:502: 00000100:00100000:1.0:1788360808.921749:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:7480:x1875232143982592:12345-0@lo:502: Request processed in 260us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360808.921757:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788360808.922199:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982592:0@lo:502: 00000040:00080000:3.0:1788360808.922467:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788360808.922520:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788360808.922568:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788360808.922628:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788360808.922680:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788360808.922730:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788360808.922839:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788360808.922890:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788360808.922943:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788360808.922989:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788360808.923020:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788360808.923071:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788360808.923133:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788360808.923166:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788360808.923228:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788360808.923268:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788360808.923305:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788360808.923351:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788360808.923388:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788360808.923423:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788360808.923471:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788360808.923509:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788360808.923557:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788360808.923619:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788360808.923654:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788360808.923700:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788360808.923748:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788360808.925980:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788360808.926053:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788360808.926158:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788360808.926199:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788360808.926235:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788360808.926270:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788360808.926319:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788360808.926356:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788360808.926404:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788360808.926440:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788360808.926491:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982720:0@lo:502: 00000100:00100000:3.0:1788360808.926957:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360808.927054:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788360808.930453:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143982720 00000100:00100000:1.0:1788360808.930470:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143982720 00000100:00100000:1.0:1788360808.930536:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788360808.930546:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:7480:x1875232143982720:12345-0@lo:502: 00000100:00100000:1.0:1788360808.930970:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:7480:x1875232143982720:12345-0@lo:502: Request processed in 425us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360808.930988:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788360808.931136:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143982720:0@lo:502: 00000040:00080000:3.0:1788360808.931248:0:7480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788360808.931263:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788360808.932000:0:7494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788360808.932013:0:7494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a8a84f14d40) 00000020:00000080:1.0:1788360808.932111:0:7494:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788360808.932295:0:7494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a898534c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788360808.932997:0:7494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a898534c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788360808.933001:0:7494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a898534c800 3 00010000:00080000:1.0:1788360808.933049:0:7494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8ab76dc000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.160@tcp at head 00010000:00010000:0.0:1788360808.938603:0:7494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788360808.938717:0:7494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788360808.938761:0:7494:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788360808.938787:0:7494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf6a94c97d6610176 00000100:00080000:0.0:1788360808.938797:0:7494:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788360808.938803:0:7494:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8ab76dc000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788360808.938839:0:7494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ab7799880 x1875232143982848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788360808.938868:0:7494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788360808.938952:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232143982976:0@lo:400: 00000100:00100000:0.0:1788360808.939020:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.939053:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360808.939059:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232143983104:0@lo:400: 00000100:00100000:0.0:1788360808.939082:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.939139:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232143983232:0@lo:400: 00000100:00100000:0.0:1788360808.939179:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.939218:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143982976 00000100:00100000:0.0:1788360808.939224:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143982976 00000100:00100000:0.0:1788360808.939258:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143983104 00000100:00100000:0.0:1788360808.939261:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143983104 00000100:00100000:0.0:1788360808.939282:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788360808.939291:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232143982976:12345-0@lo:400: 00000100:00100000:0.0:1788360808.939340:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232143982976:12345-0@lo:400: Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.939347:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788360808.939371:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788360808.939377:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232143983104:12345-0@lo:400: 00000100:00100000:0.0:1788360808.939409:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232143983104:12345-0@lo:400: Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.939415:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788360808.939442:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143983232 00000100:00100000:0.0:1788360808.939446:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143983232 00000100:00100000:0.0:1788360808.939471:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788360808.939477:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232143983232:12345-0@lo:400: 00000100:00100000:0.0:1788360808.939511:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232143983232:12345-0@lo:400: Request processed in 34us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.939517:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788360808.939556:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab7798000 x1875232143983104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360808.939569:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232143983104:0@lo:400: 00010000:00080000:0.0:1788360808.939579:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab779b800 x1875232143982976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360808.939586:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232143982976:0@lo:400: 00010000:00080000:0.0:1788360808.939615:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab779b480 x1875232143983232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360808.939622:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232143983232:0@lo:400: 00000100:00100000:2.0:1788360808.939779:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232143982848:0@lo:38: 00000100:00100000:2.0:1788360808.939811:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.942645:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143982848 00000100:00100000:0.0:1788360808.942658:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143982848 00000100:00100000:0.0:1788360808.942720:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788360808.942728:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232143982848:12345-0@lo:38: 00010000:00080000:0.0:1788360808.942764:0:5797:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1788360808.942809:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf6a94c97d661017d 00000004:00100000:0.0:1788360808.942929:0:5797:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788360808.942965:0:5797:0:(import.c:65:import_set_state_nolock()) ffff9a8ab74b1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788360808.943056:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875232143982848:12345-0@lo:38: Request processed in 327us (3242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.943064:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788360808.943151:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab7799880 x1875232143982848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788360818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360808.943164:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788360808.943173:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788360808.943180:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788360808.943185:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788360808.943189:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ab76dc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788360808.943197:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232143982848:0@lo:38: 00000040:00080000:0.0:1788360808.944455:0:7494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1788360808.945528:0:7496:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc432a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7496:1875232143983360:0@lo:901: 00000100:00100000:2.0:1788360808.945597:0:7496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360808.945630:0:7496:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788360808.946353:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143983360 00000100:00100000:0.0:1788360808.946361:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143983360 00000100:00100000:0.0:1788360808.946421:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788360808.946430:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7496:x1875232143983360:12345-0@lo:901: 00000100:00100000:0.0:1788360808.946833:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7496:x1875232143983360:12345-0@lo:901: Request processed in 403us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.946851:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788360808.946900:0:7496:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8abc432a00 x1875232143983360/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788360824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360808.946915:0:7496:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc432a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7496:1875232143983360:0@lo:901: 00000100:00080000:2.0:1788360808.947597:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:1.0:1788360808.949931:0:7480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788360808.949973:0:7480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788360808.949987:0:7480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360808.950000:0:7480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788360808.951730:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788360808.951734:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788360808.951736:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788360808.951737:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788360808.951744:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788360808.951746:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788360808.951747:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788360808.951749:0:7480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788360808.951750:0:7480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788360808.951751:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788360808.951753:0:7480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788360808.951757:0:7480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788360808.951760:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788360808.951761:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788360808.951762:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788360808.951763:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788360808.951764:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788360808.951765:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788360808.951827:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788360808.951828:0:7480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788360808.951829:0:7480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788360808.951830:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788360808.951831:0:7480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788360808.951859:0:7480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788360808.951880:0:7480:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143983488:0@lo:253: 00000100:00100000:1.0:1788360808.951958:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360808.952038:0:7480:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565600 going to sleep for 11 seconds 00000100:00100000:3.0:1788360808.952456:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143983488 00000100:00100000:3.0:1788360808.952464:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143983488 00000100:00100000:3.0:1788360808.952616:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788360808.952627:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:7480:x1875232143983488:12345-0@lo:253: 20000000:01000000:3.0:1788360808.952656:0:5791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788360808.952680:0:5791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788360808.993902:0:5791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788360808.993925:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788360808.995874:0:5813:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788360808.995884:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788360808.995907:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.995926:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66100c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66100c0 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.995946:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996000:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66100c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66100c0 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996014:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66100c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66100c0 expref: 14 pid: 5789 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.996028:0:5813:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1875232143983616:0@lo:104: 00000100:00100000:0.0:1788360808.996123:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.996167:0:5813:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788360808.996270:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143983616 00000100:00100000:2.0:1788360808.996278:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143983616 00000100:00100000:2.0:1788360808.996393:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788360808.996403:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5813:x1875232143983616:12345-0@lo:104: 00010000:00010000:2.0:1788360808.996423:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360808.996471:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788360808.996477:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:5813:x1875232143983616:12345-0@lo:104: Request processed in 76us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360808.996494:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788360808.996612:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788360808.996618:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996626:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ea00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788360808.996630:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996638:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788360808.996646:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360808.996652:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788360808.996691:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996698:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788360808.996714:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996727:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d66100c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100c7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996742:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360808.996744:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360808.996746:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360808.996758:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143983744:0@lo:103: 00000100:00100000:0.0:1788360808.996788:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360808.996826:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143983744 00000100:00100000:0.0:1788360808.996830:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143983744 00010000:00010000:0.0:1788360808.996847:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66100c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66100c0 expref: 15 pid: 5789 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.996868:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788360808.996874:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:3312:x1875232143983744:12345-0@lo:103: 00010000:00010000:0.0:1788360808.996885:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360808.996889:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66100c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66100c0 expref: 15 pid: 5789 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996899:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66100c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66100c0 expref: 15 pid: 5789 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996915:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996922:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788360808.996947:0:5784:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004028956s 00010000:00010000:0.0:1788360808.996957:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996964:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996971:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996977:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996982:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586b200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788360808.996986:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.996993:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.997002:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.997012:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360808.997041:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:3312:x1875232143983744:12345-0@lo:103: Request processed in 166us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360808.997047:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788360808.997151:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143983744:0@lo:103: 00010000:00010000:0.0:1788360808.997177:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66100c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66100c0 expref: 14 pid: 5789 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360808.997188:0:5813:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1875232143983616:0@lo:104: 00010000:00010000:0.0:1788360808.997205:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.997214:0:5813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.997219:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360808.997224:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586b200/0xf6a94c97d6610184 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360809.023495:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:7480:x1875232143983488:12345-0@lo:253: Request processed in 70852us (71518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360809.023510:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788360809.023724:0:7480:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d9fa3464-d771-4fa1-895d-6f4c1383568d:7480:1875232143983488:0@lo:253: 10000000:01000000:1.0:1788360809.023739:0:7480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788360809.023742:0:7480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788360809.023743:0:7480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788360809.023745:0:7480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788360809.023746:0:7480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788360809.023747:0:7480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788360809.023749:0:7480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788360809.023750:0:7480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788360809.023752:0:7480:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788360809.023753:0:7480:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788360809.023755:0:7480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788360809.023756:0:7480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788360809.023772:0:7480:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788360809.038054:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788360809.038638:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788360809.038869:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788360809.039251:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788360809.039592:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788360809.039837:0:7480:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788360809.041531:0:7480:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1788360809.185176:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788360809.241479:0:7480:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788360809.241487:0:7480:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788360809.241541:0:7480:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788360809.241637:0:7480:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788360809.241690:0:7480:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788360809.241710:0:7480:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788360810.210589:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360811.236510:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360812.257664:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360812.704678:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788360812.704708:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232143983872:0@lo:13: 00000100:00100000:1.0:1788360812.704778:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360812.705006:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143983872 00000100:00100000:0.0:1788360812.705015:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143983872 00000100:00100000:0.0:1788360812.705115:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788360812.705125:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232143983872:12345-0@lo:13: 00002000:00000024:0.0:1788360812.705157:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360812.705218:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232143983872:12345-0@lo:13: Request processed in 85us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360812.705226:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788360812.705269:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc431500 x1875232143983872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360812.705287:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232143983872:0@lo:13: 00000100:00080000:2.0:1788360812.705917:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788360813.281359:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788360813.898691:0:7836:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788360814.245601:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143984000:0@lo:400: 00000100:00100000:1.0:1788360814.245689:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360814.245795:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143984000 00000100:00100000:2.0:1788360814.245804:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143984000 00000100:00100000:2.0:1788360814.245863:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788360814.245874:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3314:x1875232143984000:12345-0@lo:400: 00000100:00100000:3.0:1788360814.245988:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232143984128:0@lo:400: 00000100:00100000:3.0:1788360814.246023:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360814.246060:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143984128 00000100:00100000:3.0:1788360814.246065:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143984128 00000100:00100000:3.0:1788360814.246114:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788360814.246121:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232143984128:12345-0@lo:400: 00000100:00100000:3.0:1788360814.246161:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232143984128:12345-0@lo:400: Request processed in 40us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360814.246168:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788360814.246206:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a8493b480 x1875232143984128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360814.246220:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232143984128:0@lo:400: 00000100:00100000:3.0:1788360814.246254:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232143984256:0@lo:400: 00000100:00100000:3.0:1788360814.246294:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360814.246323:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143984256 00000100:00100000:3.0:1788360814.246327:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143984256 00000100:00100000:3.0:1788360814.246362:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788360814.246369:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232143984256:12345-0@lo:400: 00000100:00100000:3.0:1788360814.246403:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232143984256:12345-0@lo:400: Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360814.246419:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788360814.246436:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788360814.246458:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a8493b480 x1875232143984256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360814.246468:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232143984256:0@lo:400: 00000100:00100000:2.0:1788360814.248804:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3314:x1875232143984000:12345-0@lo:400: Request processed in 2925us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360814.248818:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788360814.248938:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232143984384:0@lo:400: 00000100:00100000:3.0:1788360814.248988:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360814.249111:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788360814.249118:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232143984512:0@lo:400: 00000100:00100000:3.0:1788360814.249147:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360814.249172:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143984512 00000100:00100000:3.0:1788360814.249178:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143984512 00000100:00100000:3.0:1788360814.249222:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788360814.249230:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232143984512:12345-0@lo:400: 00000100:00100000:2.0:1788360814.249489:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143984384 00000100:00100000:2.0:1788360814.249501:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143984384 00000100:00100000:2.0:1788360814.249541:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788360814.249552:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232143984384:12345-0@lo:400: 00000100:00100000:2.0:1788360814.249591:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232143984384:12345-0@lo:400: Request processed in 44us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360814.249598:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788360814.249905:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232143984512:12345-0@lo:400: Request processed in 665us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360814.249912:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788360814.249932:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788360814.249937:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788360814.249965:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a8493bb80 x1875232143984512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360814.249979:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232143984512:0@lo:400: 00010000:00080000:3.0:1788360814.249989:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a8493b480 x1875232143984384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360814.249998:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232143984384:0@lo:400: 00000100:00100000:1.0:1788360814.250593:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143984000:0@lo:400: 00010000:00010000:0.0:1788360814.304291:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360815.329030:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360816.352396:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360817.381492:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788360817.826714:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788360817.826732:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a86b49000 from 30 10000000:01000000:0.0:1788360817.826737:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788360817.826768:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360817.826779:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360817.826789:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360817.826805:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232143984640:0@lo:13: 00000100:00100000:0.0:1788360817.826805:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143984768:0@lo:101: 00000100:00100000:0.0:1788360817.827881:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360817.827882:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360817.827938:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788360817.828616:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143984768 00000100:00100000:2.0:1788360817.828625:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143984768 00000100:00100000:2.0:1788360817.829029:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788360817.829041:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143984768:12345-0@lo:101: 00010000:00010000:2.0:1788360817.829056:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360817.829073:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d6610192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661018b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360817.829125:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d6610192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661018b expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360817.829136:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d6610192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661018b expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360817.829146:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45400, rc 0) 00000100:00100000:2.0:1788360817.829204:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143984768:12345-0@lo:101: Request processed in 166us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360817.829212:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788360817.829750:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143984768:0@lo:101: 00010000:00010000:2.0:1788360817.829778:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360817.829787:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360817.829848:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc430380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143984896:0@lo:501: 00000100:00100000:2.0:1788360817.829880:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360817.829905:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8badacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360817.829920:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143984896 00000100:00100000:2.0:1788360817.829924:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143984896 00000100:00100000:2.0:1788360817.829963:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788360817.829972:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143984896:12345-0@lo:501: 00000100:00100000:2.0:1788360817.830322:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143984896:12345-0@lo:501: Request processed in 340us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360817.830330:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788360817.830363:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc430380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143984896:0@lo:501: 00000100:00100000:2.0:1788360817.830390:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc430380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143985024:0@lo:503: 00000100:00100000:2.0:1788360817.830431:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360817.830454:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8badacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360817.831154:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143984640 00000100:00100000:0.0:1788360817.831159:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143984640 00000100:00100000:0.0:1788360817.831194:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788360817.831200:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232143984640:12345-0@lo:13: 00002000:00000024:0.0:1788360817.831222:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360817.831262:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232143984640:12345-0@lo:13: Request processed in 63us (3386us total) trans 0 rc 0/0 00010000:00080000:2.0:1788360817.831287:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc432d80 x1875232143984640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360817.831305:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232143984640:0@lo:13: 00000100:00100000:0.0:1788360817.831358:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788360817.832210:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788360817.833469:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143985024 00000100:00100000:1.0:1788360817.833480:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143985024 00000100:00100000:1.0:1788360817.833533:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788360817.833541:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143985024:12345-0@lo:503: 00000100:00100000:1.0:1788360817.833936:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143985024:12345-0@lo:503: Request processed in 384us (3494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360817.833945:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788360817.836113:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc430380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143985024:0@lo:503: 00000100:00100000:0.0:1788360817.838265:0:8044:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8044:1875232143985152:0@lo:502: 00000100:00100000:0.0:1788360817.838348:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360817.838403:0:8044:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.838650:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143985152 00000100:00100000:3.0:1788360817.838658:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143985152 00000100:00100000:3.0:1788360817.838702:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788360817.838711:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:8044:x1875232143985152:12345-0@lo:502: 00000100:00100000:3.0:1788360817.839267:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:8044:x1875232143985152:12345-0@lo:502: Request processed in 554us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.839276:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788360817.839354:0:8044:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8044:1875232143985152:0@lo:502: 00000100:00100000:0.0:1788360817.839406:0:8044:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8044:1875232143985280:0@lo:502: 00000100:00100000:0.0:1788360817.839452:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360817.839476:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143985280 00000100:00100000:0.0:1788360817.839480:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143985280 00000100:00100000:0.0:1788360817.839507:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788360817.839515:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:8044:x1875232143985280:12345-0@lo:502: 00000100:00100000:0.0:1788360817.840382:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:8044:x1875232143985280:12345-0@lo:502: Request processed in 865us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360817.840390:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788360817.840570:0:8044:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.840589:0:8044:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8044:1875232143985280:0@lo:502: 00000040:00080000:3.0:1788360817.840629:0:8044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788360817.840858:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788360817.840885:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788360817.840895:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.840905:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360817.840925:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788360817.840927:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788360817.840930:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788360817.840956:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.840963:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.840971:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360817.840986:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143985408:0@lo:101: 00000100:00100000:1.0:1788360817.841018:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.841043:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788360817.841129:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143985408 00000100:00100000:2.0:1788360817.841136:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143985408 00000100:00100000:2.0:1788360817.841172:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788360817.841187:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143985408:12345-0@lo:101: 00010000:00010000:2.0:1788360817.841551:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360817.841564:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b44a00/0xf6a94c97d66101a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610199 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360817.841587:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b44a00/0xf6a94c97d66101a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610199 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360817.841597:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8b44a00/0xf6a94c97d66101a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610199 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360817.841616:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44a00, rc 0) 00000100:00100000:1.0:1788360817.841698:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143985408:0@lo:101: 00010000:00010000:1.0:1788360817.841711:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.841719:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360817.841765:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143985536:0@lo:501: 00000100:00100000:2.0:1788360817.842384:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143985408:12345-0@lo:101: Request processed in 1198us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360817.842392:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788360817.844039:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.844180:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788360817.844249:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143985536 00000100:00100000:2.0:1788360817.844257:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143985536 00000100:00100000:2.0:1788360817.844297:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788360817.844305:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143985536:12345-0@lo:501: 00000100:00100000:2.0:1788360817.844533:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143985536:12345-0@lo:501: Request processed in 228us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360817.844540:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788360817.847790:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143985536:0@lo:501: 00000100:00100000:1.0:1788360817.847840:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143985664:0@lo:503: 00000100:00100000:1.0:1788360817.847915:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360817.847955:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143985664 00000100:00100000:1.0:1788360817.847957:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788360817.847963:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143985664 00000100:00100000:2.0:1788360817.848006:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788360817.848014:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143985664:12345-0@lo:503: 00000100:00100000:2.0:1788360817.848808:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143985664:12345-0@lo:503: Request processed in 791us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360817.848825:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788360817.849202:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143985664:0@lo:503: 00000100:00100000:1.0:1788360817.849889:0:8046:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8046:1875232143985792:0@lo:502: 00000100:00100000:1.0:1788360817.849936:0:8046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.850000:0:8046:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.850039:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143985792 00000100:00100000:3.0:1788360817.850044:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143985792 00000100:00100000:3.0:1788360817.850100:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788360817.850109:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:8046:x1875232143985792:12345-0@lo:502: 00000100:00100000:3.0:1788360817.850365:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:8046:x1875232143985792:12345-0@lo:502: Request processed in 257us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.850373:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788360817.850436:0:8046:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8046:1875232143985792:0@lo:502: 00000020:01000000:1.0:1788360817.850460:0:8046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788360817.850468:0:8046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360817.850470:0:8046:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788360817.850474:0:8046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788360817.850476:0:8046:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788360817.850492:0:8046:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8046:1875232143985920:0@lo:502: 00000100:00100000:1.0:1788360817.850523:0:8046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.850581:0:8046:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.850703:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143985920 00000100:00100000:3.0:1788360817.850708:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143985920 00000100:00100000:3.0:1788360817.850773:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788360817.850780:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:8046:x1875232143985920:12345-0@lo:502: 00000100:00100000:3.0:1788360817.850896:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:8046:x1875232143985920:12345-0@lo:502: Request processed in 116us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.850902:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788360817.850959:0:8046:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8046:1875232143985920:0@lo:502: 00000020:01000000:1.0:1788360817.850979:0:8046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788360817.850983:0:8046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360817.850985:0:8046:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788360817.850989:0:8046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788360817.851160:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788360817.851175:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788360817.851184:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.851200:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360817.851209:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788360817.851211:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a83778000 from 30 10000000:01000000:3.0:1788360817.851214:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788360817.851237:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.851244:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.851252:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360817.851264:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986048:0@lo:101: 00000100:00100000:3.0:1788360817.851292:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360817.851344:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026240 going to sleep for 11 seconds 00000100:00100000:1.0:1788360817.851375:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143986048 00000100:00100000:1.0:1788360817.851379:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143986048 00000100:00100000:1.0:1788360817.851404:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788360817.851409:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143986048:12345-0@lo:101: 00010000:00010000:1.0:1788360817.851418:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360817.851430:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66101ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66101a7 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.851462:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66101ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66101a7 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.851472:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66101ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66101a7 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.851481:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813ca800, rc 0) 00000100:00100000:1.0:1788360817.851550:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143986048:12345-0@lo:101: Request processed in 141us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360817.851556:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788360817.851615:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986048:0@lo:101: 00010000:00010000:3.0:1788360817.851628:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.851636:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360817.851677:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986176:0@lo:501: 00000100:00100000:3.0:1788360817.851702:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360817.851768:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026240 going to sleep for 11 seconds 00000100:00100000:1.0:1788360817.851800:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143986176 00000100:00100000:1.0:1788360817.851804:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143986176 00000100:00100000:1.0:1788360817.851861:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788360817.851868:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143986176:12345-0@lo:501: 00000100:00100000:1.0:1788360817.852060:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143986176:12345-0@lo:501: Request processed in 191us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360817.852066:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788360817.852168:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986176:0@lo:501: 00000100:00100000:1.0:1788360817.852195:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986304:0@lo:503: 00000100:00100000:1.0:1788360817.852229:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.852279:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bac83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.852310:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143986304 00000100:00100000:3.0:1788360817.852314:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143986304 00000100:00100000:3.0:1788360817.852370:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788360817.852377:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143986304:12345-0@lo:503: 00000100:00100000:3.0:1788360817.852503:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143986304:12345-0@lo:503: Request processed in 125us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.852510:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788360817.852564:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986304:0@lo:503: 00000100:00100000:1.0:1788360817.852714:0:8047:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8047:1875232143986432:0@lo:502: 00000100:00100000:1.0:1788360817.852748:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.852765:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143986432 00000100:00100000:1.0:1788360817.852773:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143986432 00000100:00100000:1.0:1788360817.852796:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788360817.852803:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:8047:x1875232143986432:12345-0@lo:502: 00000100:00100000:1.0:1788360817.852943:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:8047:x1875232143986432:12345-0@lo:502: Request processed in 140us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360817.852950:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788360817.852982:0:8047:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bac8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788360817.852993:0:8047:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8047:1875232143986432:0@lo:502: 00000100:00100000:1.0:1788360817.853027:0:8047:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8047:1875232143986560:0@lo:502: 00000100:00100000:1.0:1788360817.853057:0:8047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.854453:0:8047:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.854753:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143986560 00000100:00100000:3.0:1788360817.854761:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143986560 00000100:00100000:3.0:1788360817.854845:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788360817.854855:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:8047:x1875232143986560:12345-0@lo:502: 00000100:00100000:3.0:1788360817.855101:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:8047:x1875232143986560:12345-0@lo:502: Request processed in 232us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.855109:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788360817.855211:0:8047:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8047:1875232143986560:0@lo:502: 00000040:00080000:1.0:1788360817.855243:0:8047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788360817.855580:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788360817.855599:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788360817.855616:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.855627:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360817.855636:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788360817.855639:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8a83778000 from 5 10000000:01000000:3.0:1788360817.855641:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788360817.855673:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.855694:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.855704:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360817.855722:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986688:0@lo:101: 00000100:00100000:3.0:1788360817.855757:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360817.855818:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026240 going to sleep for 11 seconds 00000100:00100000:1.0:1788360817.855848:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143986688 00000100:00100000:1.0:1788360817.855852:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143986688 00000100:00100000:1.0:1788360817.855912:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788360817.855920:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143986688:12345-0@lo:101: 00010000:00010000:1.0:1788360817.855930:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360817.855943:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d66101bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66101b5 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.855964:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d66101bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66101b5 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.855973:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d66101bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66101b5 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.855981:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813cb800, rc 0) 00000100:00100000:1.0:1788360817.856019:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143986688:12345-0@lo:101: Request processed in 100us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360817.856025:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788360817.856055:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986688:0@lo:101: 00010000:00010000:1.0:1788360817.856067:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.856075:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360817.856140:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986816:0@lo:256: 00000100:00100000:1.0:1788360817.856171:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.856188:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360817.856198:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143986816 00000100:00100000:1.0:1788360817.856201:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143986816 00000100:00100000:1.0:1788360817.856218:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788360817.856224:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143986816:12345-0@lo:256: 20000000:01000000:1.0:1788360817.856237:0:5792:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788360817.856252:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788360817.856256:0:5792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788360817.856392:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143986816:12345-0@lo:256: Request processed in 166us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360817.856400:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788360817.856666:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986816:0@lo:256: 10000000:01000000:1.0:1788360817.856709:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788360817.856715:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.856733:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360817.856739:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788360817.856741:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788360817.856744:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788360817.856760:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.856767:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.856775:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360817.856785:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986944:0@lo:101: 00000100:00100000:1.0:1788360817.856808:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.857226:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.857261:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143986944 00000100:00100000:3.0:1788360817.857267:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143986944 00000100:00100000:3.0:1788360817.859153:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788360817.859171:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143986944:12345-0@lo:101: 00010000:00010000:3.0:1788360817.859188:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360817.859207:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d66101ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66101c3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.859235:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d66101ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66101c3 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.859247:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d66101ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66101c3 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.859255:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f400, rc 0) 00000100:00100000:3.0:1788360817.859598:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143986944:12345-0@lo:101: Request processed in 432us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.859614:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788360817.859742:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143986944:0@lo:101: 00010000:00010000:1.0:1788360817.859761:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360817.859772:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360817.859846:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143987072:0@lo:501: 00000100:00100000:1.0:1788360817.859883:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.859919:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360817.859934:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143987072 00000100:00100000:1.0:1788360817.859939:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143987072 00000100:00100000:1.0:1788360817.859970:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788360817.859978:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143987072:12345-0@lo:501: 00000100:00100000:1.0:1788360817.860234:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143987072:12345-0@lo:501: Request processed in 256us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360817.860240:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788360817.860269:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143987072:0@lo:501: 00000100:00100000:1.0:1788360817.860295:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143987200:0@lo:503: 00000100:00100000:1.0:1788360817.860595:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.860658:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.860692:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143987200 00000100:00100000:3.0:1788360817.860702:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143987200 00000100:00100000:3.0:1788360817.860725:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788360817.860731:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143987200:12345-0@lo:503: 00000100:00100000:3.0:1788360817.861000:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143987200:12345-0@lo:503: Request processed in 268us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.861007:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788360817.861076:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143987200:0@lo:503: 00000100:00100000:0.0:1788360817.862375:0:8049:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8049:1875232143987328:0@lo:502: 00000100:00100000:0.0:1788360817.862446:0:8049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360817.862537:0:8049:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.862692:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143987328 00000100:00100000:3.0:1788360817.862698:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143987328 00000100:00100000:3.0:1788360817.862731:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788360817.862737:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8049:x1875232143987328:12345-0@lo:502: 00000100:00100000:3.0:1788360817.862999:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8049:x1875232143987328:12345-0@lo:502: Request processed in 261us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.863007:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788360817.863203:0:8049:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8049:1875232143987328:0@lo:502: 00000020:01000000:0.0:1788360817.863229:0:8049:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788360817.863236:0:8049:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788360817.863243:0:8049:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360817.863245:0:8049:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788360817.863916:0:8049:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788360817.863923:0:8049:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:0.0:1788360817.863949:0:8049:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788360817.863952:0:8049:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788360817.863967:0:8049:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a8a90bf4d40) 00000020:00000080:0.0:1788360817.863988:0:8049:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788360817.863996:0:8049:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788360817.864418:0:8049:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788360817.864425:0:8049:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788360817.864432:0:8049:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66101d8 00010000:00080000:0.0:1788360817.864460:0:8049:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a89852f1800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:0.0:1788360817.864681:0:8049:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788360817.865004:0:8049:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788360817.865016:0:8049:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788360817.865550:0:8049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788360817.865754:0:8049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788360817.865798:0:8049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788360817.865850:0:8049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788360817.866715:0:8050:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788360817.866720:0:8050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788360817.867715:0:8049:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788360817.867727:0:8049:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788360817.867759:0:8049:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788360817.867779:0:8049:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66101df 00000100:00080000:1.0:1788360817.867789:0:8049:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788360817.867794:0:8049:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a89852f1800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788360817.867828:0:8049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a83543800 x1875232143987456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788360817.867927:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232143987456:0@lo:8: 00000100:00100000:2.0:1788360817.867997:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360817.868108:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143987456 00000100:00100000:3.0:1788360817.868115:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143987456 00000100:00100000:3.0:1788360817.868147:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788360817.868153:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232143987456:12345-0@lo:8: 00010000:00080000:3.0:1788360817.868176:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:3.0:1788360817.868198:0:6592:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66101e6 00002000:00100000:3.0:1788360817.868210:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a8a8a586800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788360817.868214:0:6592:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788360817.868218:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788360817.868328:0:6592:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1788360817.868388:0:8049:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788360817.868441:0:8049:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788360817.868445:0:8049:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360817.868447:0:8049:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788360817.868461:0:8049:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788360817.868464:0:8049:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00002000:00080000:3.0:1788360817.868465:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000020:00000080:1.0:1788360817.868466:0:8049:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788360817.868469:0:8049:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788360817.868470:0:8049:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00080000:3.0:1788360817.868487:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a587800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788360817.868493:0:8049:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8049:1875232143987584:0@lo:502: 00000100:00100000:2.0:1788360817.868806:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232143987712:0@lo:400: 00000100:00100000:1.0:1788360817.868838:0:8049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360817.868848:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232143987456:12345-0@lo:8: Request processed in 694us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360817.868860:0:8049:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bac83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.868863:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788360817.868873:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143987584 00000100:00100000:1.0:1788360817.868877:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143987584 00000100:00100000:1.0:1788360817.868904:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788360817.868910:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8049:x1875232143987584:12345-0@lo:502: 00000100:00100000:2.0:1788360817.869021:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360817.869112:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232143987840:0@lo:400: 00000100:00100000:1.0:1788360817.869124:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8049:x1875232143987584:12345-0@lo:502: Request processed in 214us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360817.869131:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788360817.869136:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360817.869200:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788360817.869206:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232143987968:0@lo:400: 00000100:00100000:2.0:1788360817.869227:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360817.869242:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143987712 00000100:00100000:3.0:1788360817.869246:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143987712 00000100:00100000:3.0:1788360817.869271:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143987840 00000100:00100000:3.0:1788360817.869274:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143987840 00000100:00100000:3.0:1788360817.869300:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788360817.869306:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232143987712:12345-0@lo:400: 00000100:00100000:3.0:1788360817.869353:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232143987712:12345-0@lo:400: Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.869359:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788360817.869370:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788360817.869376:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232143987840:12345-0@lo:400: 00000100:00100000:3.0:1788360817.869398:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232143987840:12345-0@lo:400: Request processed in 23us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.869402:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788360817.869602:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc431500 x1875232143987840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360817.869626:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232143987840:0@lo:400: 00000100:00100000:3.0:1788360817.869682:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143987968 00000100:00100000:3.0:1788360817.869686:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143987968 00000100:00100000:3.0:1788360817.869710:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788360817.869715:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232143987968:12345-0@lo:400: 00000100:00100000:3.0:1788360817.869748:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232143987968:12345-0@lo:400: Request processed in 32us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.869754:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788360817.869810:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc430380 x1875232143987712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360817.869820:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232143987712:0@lo:400: 00010000:00080000:2.0:1788360817.869840:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc430700 x1875232143987968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360817.869846:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232143987968:0@lo:400: 00010000:00080000:2.0:1788360817.870065:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a83543800 x1875232143987456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788360827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360817.870073:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788360817.870079:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:1.0:1788360817.870105:0:8049:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8049:1875232143987584:0@lo:502: 00000100:00080000:2.0:1788360817.870109:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788360817.870114:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788360817.870118:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89852f1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788360817.870127:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000020:01000000:1.0:1788360817.870130:0:8049:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1788360817.870133:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232143987456:0@lo:8: 00000020:00000080:1.0:1788360817.870135:0:8049:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360817.870137:0:8049:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788360817.870141:0:8049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:2.0:1788360817.870151:0:8050:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788360817.870252:0:8050:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 207885165172ns, next at 0ns, rc = 0 00000100:00080000:0.0:1788360817.871923:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1788360817.871952:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788360817.871976:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788360817.871987:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360817.871998:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360817.872008:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788360817.872010:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a8a85713380 from 1 10000000:01000000:0.0:1788360817.872013:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788360817.872043:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360817.872050:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360817.872059:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360817.872112:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143988096:0@lo:101: 00000100:00100000:0.0:1788360817.872169:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360817.872210:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143988096 00000100:00100000:0.0:1788360817.872214:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.872219:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143988096 00000100:00100000:3.0:1788360817.872257:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788360817.872265:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143988096:12345-0@lo:101: 00010000:00010000:3.0:1788360817.872277:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360817.872294:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66101f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66101ed expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.872328:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66101f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66101ed expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.872339:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66101f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66101ed expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360817.872347:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:3.0:1788360817.872384:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143988096:12345-0@lo:101: Request processed in 119us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360817.872390:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788360817.872571:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143988096:0@lo:101: 00010000:00010000:0.0:1788360817.872591:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360817.872600:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360817.872656:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143988224:0@lo:501: 00000100:00100000:0.0:1788360817.872681:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360817.872707:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788360817.873128:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143988224 00000100:00100000:3.0:1788360817.873133:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143988224 00000100:00100000:3.0:1788360817.873158:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788360817.873164:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143988224:12345-0@lo:501: 00000100:00100000:3.0:1788360817.873361:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143988224:12345-0@lo:501: Request processed in 195us (678us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788360817.873370:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788360817.878482:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143988224:0@lo:501: 10000000:01000000:0.0:1788360817.878524:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788360817.878534:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360817.878544:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788360817.899863:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:1.0:1788360817.911115:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:0.0:1788360817.949269:0:8051:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788360817.949298:0:8051:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8051:1875232143988480:0@lo:7: 00000100:00100000:0.0:1788360817.949364:0:8051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360817.949406:0:8051:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788360817.949425:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143988480 00000100:00100000:0.0:1788360817.949433:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143988480 00000100:00100000:0.0:1788360817.949493:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788360817.949501:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8051:x1875232143988480:12345-0@lo:7: 00000100:00100000:2.0:1788360817.951801:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232143988352:0@lo:13: 00000100:00100000:2.0:1788360817.951863:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360817.951929:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143988352 00000100:00100000:2.0:1788360817.951937:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143988352 00000100:00100000:2.0:1788360817.951981:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788360817.951990:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232143988352:12345-0@lo:13: 00002000:00000024:2.0:1788360817.952015:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788360817.952060:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232143988352:12345-0@lo:13: Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360817.952067:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788360817.952117:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8986704700 x1875232143988352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360817.952137:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232143988352:0@lo:13: 00000100:00080000:1.0:1788360817.953151:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788360817.956372:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788360817.956382:0:6593:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788360817.956530:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8051:x1875232143988480:12345-0@lo:7: Request processed in 7026us (7162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360817.956541:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788360817.956629:0:8051:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8986705f80 x1875232143988480/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788360833 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360817.956644:0:8051:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8051:1875232143988480:0@lo:7: 00000004:00080000:1.0:1788360817.956657:0:8051:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788360817.956776:0:8051:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8051:1875232143988608:0@lo:5: 00000100:00100000:1.0:1788360817.956818:0:8051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.956904:0:8051:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360817.956996:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143988608 00000100:00100000:0.0:1788360817.957003:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143988608 00000100:00100000:0.0:1788360817.957043:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788360817.957051:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8051:x1875232143988608:12345-0@lo:5: 00002000:00080000:0.0:1788360817.957076:0:6592:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788360817.957079:0:6592:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788360817.957499:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8051:x1875232143988608:12345-0@lo:5: Request processed in 448us (680us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788360817.957506:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788360817.957573:0:8051:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a83542680 x1875232143988608/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788360833 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360817.957586:0:8051:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8051:1875232143988608:0@lo:5: 00000004:00080000:1.0:1788360817.957594:0:8051:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788360817.957633:0:8051:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8051:1875232143988736:0@lo:700: 00000100:00100000:1.0:1788360817.957660:0:8051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.957748:0:8051:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788360817.957763:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143988736 00000100:00100000:1.0:1788360817.957766:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143988736 00000100:00100000:1.0:1788360817.957794:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788360817.957800:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8051:x1875232143988736:12345-0@lo:700: 00000100:00100000:1.0:1788360817.957828:0:6601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6601:1875232143988864:0@lo:700: 00000100:00100000:1.0:1788360817.957856:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360817.958274:0:6601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788360817.958297:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143988864 00000100:00100000:1.0:1788360817.958301:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143988864 00000100:00100000:1.0:1788360817.958328:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788360817.958335:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6601:x1875232143988864:12345-0@lo:700: 40000000:02000000:1.0:1788360818.011457:0:5804:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788360818.021504:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6601:x1875232143988864:12345-0@lo:700: Request processed in 63163us (63640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360818.021518:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788360818.021575:0:6601:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a83542d80 x1875232143988864/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788360833 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360818.021602:0:6601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6601:1875232143988864:0@lo:700: 40000000:02000000:1.0:1788360818.021814:0:6601:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788360818.090788:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1788360818.142238:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8051:x1875232143988736:12345-0@lo:700: Request processed in 184430us (184569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360818.142253:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788360818.142268:0:8051:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a83540380 x1875232143988736/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788360833 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360818.142281:0:8051:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788360818.142297:0:8051:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8051:1875232143988736:0@lo:700: 00000100:00100000:0.0:1788360818.184020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360818.184283:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130334848 00000100:00100000:3.0:1788360818.184294:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130334848 00000100:00100000:3.0:1788360818.184332:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:3.0:1788360818.184340:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2348:x1875232130334848:12345-192.168.203.60@tcp:250: 00010000:00080000:3.0:1788360818.184377:0:5792:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bee34693-2e5d-4e3f-a247-33b45ac274f5@192.168.203.60@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1788360818.184412:0:5792:0:(genops.c:1406:class_connect()) connect: client bee34693-2e5d-4e3f-a247-33b45ac274f5, cookie 0xf6a94c97d66101fb 00000100:00080000:3.0:1788360818.184538:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a584800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788360818.184600:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+5:2348:x1875232130334848:12345-192.168.203.60@tcp:250: Request processed in 258us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360818.184618:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00000004:02000040:3.0:1788360818.194957:0:8051:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788360818.204002:0:8051:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8051:1875232143988992:0@lo:5: 00000100:00100000:1.0:1788360818.204020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360818.204061:0:8051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360818.204072:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130334976 00000100:00100000:1.0:1788360818.204081:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130334976 00000100:00100000:3.0:1788360818.204124:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143988992 00000100:00100000:3.0:1788360818.204129:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143988992 00000100:00100000:3.0:1788360818.204170:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788360818.204172:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:3.0:1788360818.204181:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8051:x1875232143988992:12345-0@lo:5: 00000100:00100000:1.0:1788360818.204187:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+5:5548:x1875232130334976:12345-192.168.203.60@tcp:101: 00010000:00010000:1.0:1788360818.204199:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360818.204217:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813cb200/0xf6a94c97d6610202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e0b6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360818.204256:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813cb200/0xf6a94c97d6610202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0b6 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360818.204269:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813cb200/0xf6a94c97d6610202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0b6 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360818.204279:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813cb200, rc 0) 00000100:00100000:1.0:1788360818.204736:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+6:5548:x1875232130334976:12345-192.168.203.60@tcp:101: Request processed in 551us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360818.204744:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:2.0:1788360818.210938:0:8051:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a1600 going to sleep for 11 seconds 00002000:00080000:3.0:1788360818.213643:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788360818.213663:0:6593:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788360818.214707:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360818.220705:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130335104 00000100:00100000:1.0:1788360818.220718:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130335104 00000100:00100000:1.0:1788360818.220771:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788360818.220786:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+6:5548:x1875232130335104:12345-192.168.203.60@tcp:501: 00000100:00100000:1.0:1788360818.221027:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+6:5548:x1875232130335104:12345-192.168.203.60@tcp:501: Request processed in 244us (6322us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788360818.221042:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:3.0:1788360818.232662:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8051:x1875232143988992:12345-0@lo:5: Request processed in 28476us (28593us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788360818.232754:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788360818.232814:0:8051:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a8493ad80 x1875232143988992/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788360834 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360818.232831:0:8051:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8051:1875232143988992:0@lo:5: 00000004:00080000:3.0:1788360818.232844:0:8051:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788360818.235286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360818.236388:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130335232 00000100:00100000:2.0:1788360818.236399:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130335232 00000100:00100000:2.0:1788360818.236459:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:2.0:1788360818.236470:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+6:5548:x1875232130335232:12345-192.168.203.60@tcp:101: 00010000:00010000:2.0:1788360818.236485:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360818.236512:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d6610209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e0bd expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360818.236541:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d6610209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0bd expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360818.236554:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d6610209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0bd expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360818.236563:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45a00, rc 0) 00000100:00100000:2.0:1788360818.237138:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+7:5548:x1875232130335232:12345-192.168.203.60@tcp:101: Request processed in 668us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360818.237148:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:3.0:1788360818.240182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360818.240264:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130335360 00000100:00100000:1.0:1788360818.240273:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130335360 00000100:00100000:0.0:1788360818.240371:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:0.0:1788360818.240384:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+7:5548:x1875232130335360:12345-192.168.203.60@tcp:501: 00000100:00100000:0.0:1788360818.240669:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:5548:x1875232130335360:12345-192.168.203.60@tcp:501: Request processed in 287us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360818.240679:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:1.0:1788360818.248793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360818.248979:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130335488 00000100:00100000:0.0:1788360818.248988:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130335488 00000100:00100000:0.0:1788360818.249038:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:0.0:1788360818.249046:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:5548:x1875232130335488:12345-192.168.203.60@tcp:503: 00000100:00100000:0.0:1788360818.249319:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:5548:x1875232130335488:12345-192.168.203.60@tcp:503: Request processed in 273us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360818.249333:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:2.0:1788360818.252824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360818.253048:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130335616 00000100:00100000:3.0:1788360818.253058:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130335616 00000100:00100000:3.0:1788360818.253124:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:3.0:1788360818.253147:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:5567:x1875232130335616:12345-192.168.203.60@tcp:502: 00000100:00100000:3.0:1788360818.253526:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:5567:x1875232130335616:12345-192.168.203.60@tcp:502: Request processed in 379us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360818.253535:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:1.0:1788360818.274228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360818.274323:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130335744 00000100:00100000:2.0:1788360818.274334:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130335744 00000100:00100000:2.0:1788360818.274415:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:2.0:1788360818.274426:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:5567:x1875232130335744:12345-192.168.203.60@tcp:502: 00000100:00100000:2.0:1788360818.274701:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:5567:x1875232130335744:12345-192.168.203.60@tcp:502: Request processed in 276us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360818.274710:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:1.0:1788360818.278821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360818.280767:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130335872 00000100:00100000:0.0:1788360818.280780:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130335872 00000100:00100000:0.0:1788360818.281689:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:0.0:1788360818.281702:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:5548:x1875232130335872:12345-192.168.203.60@tcp:101: 00010000:00010000:0.0:1788360818.281721:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360818.289394:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586a200/0xf6a94c97d6610210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e0e7 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360818.289432:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586a200/0xf6a94c97d6610210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0e7 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360818.289443:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586a200/0xf6a94c97d6610210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0e7 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360818.289501:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586a200, rc 0) 00000100:00100000:0.0:1788360818.289567:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5548:x1875232130335872:12345-192.168.203.60@tcp:101: Request processed in 7867us (10755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360818.289576:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:0.0:1788360818.292274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360818.293148:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130336000 00000100:00100000:0.0:1788360818.293159:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130336000 00000100:00100000:0.0:1788360818.293373:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1788360818.293384:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5548:x1875232130336000:12345-192.168.203.60@tcp:256: 20000000:01000000:0.0:1788360818.293407:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788360818.293422:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788360818.293426:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788360818.293433:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788360818.293436:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788360818.298199:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5548:x1875232130336000:12345-192.168.203.60@tcp:256: Request processed in 4804us (6023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360818.298212:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1788360818.308211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360818.308248:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130336128 00000100:00100000:0.0:1788360818.308258:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130336128 00000100:00100000:0.0:1788360818.308306:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:0.0:1788360818.308316:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5548:x1875232130336128:12345-192.168.203.60@tcp:101: 00010000:00010000:0.0:1788360818.308334:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360818.308351:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610217 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e0ee expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360818.308379:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0ee expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360818.308391:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0ee expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360818.308401:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586b400, rc 0) 00000100:00100000:0.0:1788360818.308534:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5548:x1875232130336128:12345-192.168.203.60@tcp:101: Request processed in 218us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360818.308541:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:2.0:1788360818.313730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360818.313873:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130336256 00000100:00100000:3.0:1788360818.313883:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130336256 00000100:00100000:3.0:1788360818.313940:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:3.0:1788360818.313952:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5548:x1875232130336256:12345-192.168.203.60@tcp:501: 00000100:00100000:3.0:1788360818.314218:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5548:x1875232130336256:12345-192.168.203.60@tcp:501: Request processed in 269us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360818.314226:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:1.0:1788360818.318336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360818.318381:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130336384 00000100:00100000:1.0:1788360818.318390:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130336384 00000100:00100000:1.0:1788360818.318453:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:1.0:1788360818.318462:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a867e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5548:x1875232130336384:12345-192.168.203.60@tcp:503: 00000100:00100000:1.0:1788360818.320070:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a867e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5548:x1875232130336384:12345-192.168.203.60@tcp:503: Request processed in 1602us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360818.320081:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:1.0:1788360818.326434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360818.326616:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130336512 00000100:00100000:3.0:1788360818.326626:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130336512 00000100:00100000:3.0:1788360818.326684:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:3.0:1788360818.326694:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a867e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5573:x1875232130336512:12345-192.168.203.60@tcp:502: 00000100:00100000:3.0:1788360818.327520:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a867e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5573:x1875232130336512:12345-192.168.203.60@tcp:502: Request processed in 826us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360818.327530:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:0.0:1788360818.330117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360818.330162:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130336640 00000100:00100000:3.0:1788360818.330172:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130336640 00000100:00100000:3.0:1788360818.330220:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:3.0:1788360818.330229:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5573:x1875232130336640:12345-192.168.203.60@tcp:502: 00000100:00100000:3.0:1788360818.330441:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5573:x1875232130336640:12345-192.168.203.60@tcp:502: Request processed in 212us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360818.330449:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:1.0:1788360818.334295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360818.334348:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130336768 00000100:00100000:3.0:1788360818.334359:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130336768 00000100:00100000:3.0:1788360818.334401:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788360818.334410:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1875232130336768:12345-192.168.203.60@tcp:38: 00010000:00080000:3.0:1788360818.334441:0:5799:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1788360818.334489:0:5799:0:(genops.c:1406:class_connect()) connect: client 11e5d128-044a-45c3-b501-2dba6e5a82fa, cookie 0xf6a94c97d661021e 00000004:00100000:3.0:1788360818.334519:0:5799:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788360818.334526:0:5799:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788360818.358346:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00080000:3.0:1788360818.367690:0:5799:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a582000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788360818.367765:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2348:x1875232130336768:12345-192.168.203.60@tcp:38: Request processed in 33354us (33478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360818.367774:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00010000:00010000:3.0:1788360818.413827:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360819.371431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360819.371525:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130336896 00000100:00100000:3.0:1788360819.371536:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130336896 00000100:00100000:3.0:1788360819.371618:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788360819.371630:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:0:x1875232130336896:12345-192.168.203.60@tcp:41: 00000100:00080000:1.0:1788360819.371642:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788360819.371673:0:6736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788360819.371743:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:0:x1875232130336896:12345-192.168.203.60@tcp:41: Request processed in 117us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360819.371750:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788360819.372667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360819.373021:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130337024 00000100:00100000:2.0:1788360819.373027:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130337024 00000100:00100000:2.0:1788360819.373071:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788360819.373079:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:5548:x1875232130337024:12345-192.168.203.60@tcp:41: 00000004:00000024:2.0:1788360819.373124:0:5798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788360819.373172:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:5548:x1875232130337024:12345-192.168.203.60@tcp:41: Request processed in 93us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360819.373191:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788360819.376638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360819.377612:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130337152 00000100:00100000:3.0:1788360819.377626:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130337152 00000100:00100000:3.0:1788360819.377707:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788360819.377717:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:5548:x1875232130337152:12345-192.168.203.60@tcp:40: 00000100:00100000:3.0:1788360819.377816:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:5548:x1875232130337152:12345-192.168.203.60@tcp:40: Request processed in 100us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360819.377824:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788360819.380129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360819.380242:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130337536 00000100:00100000:2.0:1788360819.380252:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130337536 00000100:00100000:2.0:1788360819.380311:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788360819.380322:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:5548:x1875232130337536:12345-192.168.203.60@tcp:33: 00000100:00100000:3.0:1788360819.385196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360819.385245:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360819.385272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360819.385297:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130337280 00000100:00100000:3.0:1788360819.385307:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130337280 00000100:00100000:0.0:1788360819.385451:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130337664 00000100:00100000:0.0:1788360819.385456:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130337664 00000100:00100000:0.0:1788360819.385492:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:0.0:1788360819.385502:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2350:x1875232130337664:12345-192.168.203.60@tcp:400: 00000100:00100000:0.0:1788360819.385578:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2350:x1875232130337664:12345-192.168.203.60@tcp:400: Request processed in 77us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360819.385587:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:0.0:1788360819.385714:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788360819.385720:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875232130337280:12345-192.168.203.60@tcp:8: 00010000:00080000:0.0:1788360819.385743:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1788360819.385768:0:6592:0:(genops.c:1406:class_connect()) connect: client 11e5d128-044a-45c3-b501-2dba6e5a82fa, cookie 0xf6a94c97d6610225 00002000:00100000:0.0:1788360819.385779:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 11e5d128-044a-45c3-b501-2dba6e5a82fa/ffff9a8abccc1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788360819.385801:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788360819.386145:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788360819.386172:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a8abccc5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788360819.386210:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2348:x1875232130337280:12345-192.168.203.60@tcp:8: Request processed in 488us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360819.386218:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788360819.386414:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130337408 00000100:00100000:3.0:1788360819.386421:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130337408 00000100:00100000:3.0:1788360819.386451:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788360819.386456:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875232130337408:12345-192.168.203.60@tcp:8: 00010000:00080000:3.0:1788360819.386473:0:6594:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1788360819.386491:0:6594:0:(genops.c:1406:class_connect()) connect: client 11e5d128-044a-45c3-b501-2dba6e5a82fa, cookie 0xf6a94c97d661022c 00002000:00100000:3.0:1788360819.386497:0:6594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11e5d128-044a-45c3-b501-2dba6e5a82fa/ffff9a8a8a581000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788360819.386504:0:6594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788360819.386749:0:6594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788360819.386765:0:6594:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a587000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788360819.386808:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2348:x1875232130337408:12345-192.168.203.60@tcp:8: Request processed in 350us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360819.386815:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000004:00080000:0.0:1788360819.403989:0:5800:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23346us 00010000:00010000:2.0:1788360819.425997:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:0.0:1788360819.428791:0:5800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788360819.428984:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:5548:x1875232130337536:12345-192.168.203.60@tcp:33: Request processed in 48659us (48860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360819.428999:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788360819.604854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360819.605520:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130337792 00000100:00100000:3.0:1788360819.605530:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130337792 00000100:00100000:3.0:1788360819.605661:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788360819.605676:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:5590:x1875232130337792:12345-192.168.203.60@tcp:101: 00010000:00010000:3.0:1788360819.605710:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360819.605820:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6610233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e118 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360819.606029:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d661023a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360819.606485:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d661023a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360819.606502:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d661023a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360819.606713:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788360819.606717:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788360819.607473:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d661023a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360819.607511:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6610233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e118 expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360819.607531:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d661023a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e118 expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360819.607540:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526d00) 00010000:00010000:3.0:1788360819.607543:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788360819.607547:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e200, rc 0) 00000100:00100000:3.0:1788360819.607693:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:5590:x1875232130337792:12345-192.168.203.60@tcp:101: Request processed in 2021us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360819.607703:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000001:00100000:3.0:1788360820.445722:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00010000:00010000:3.0:1788360820.448292:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360821.473358:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360821.524799:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360821.524905:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130337920 00000100:00100000:3.0:1788360821.524915:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130337920 00000100:00100000:3.0:1788360821.525004:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788360821.525015:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:5642:x1875232130337920:12345-192.168.203.60@tcp:41: 00000004:00000024:3.0:1788360821.525066:0:6736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788360821.525166:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:5642:x1875232130337920:12345-192.168.203.60@tcp:41: Request processed in 152us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360821.525173:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:1.0:1788360821.527394:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788360821.529741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360821.529837:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130338048 00000100:00100000:2.0:1788360821.529847:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130338048 00000100:00080000:1.0:1788360821.530031:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788360821.530070:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788360821.530082:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:5642:x1875232130338048:12345-192.168.203.60@tcp:13: 00002000:00000024:2.0:1788360821.530156:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788360821.530220:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:5642:x1875232130338048:12345-192.168.203.60@tcp:13: Request processed in 141us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360821.530227:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788360821.534039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360821.534177:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130338176 00000100:00100000:3.0:1788360821.534187:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130338176 00000100:00100000:3.0:1788360821.534254:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788360821.534264:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:5642:x1875232130338176:12345-192.168.203.60@tcp:13: 00002000:00000024:3.0:1788360821.534304:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788360821.534358:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788360821.534415:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:5642:x1875232130338176:12345-192.168.203.60@tcp:13: Request processed in 152us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360821.534425:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:3.0:1788360822.498939:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360822.944607:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143989120:0@lo:400: 00000100:00100000:2.0:1788360822.944681:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360822.944734:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232143989632:0@lo:400: 00000100:00100000:2.0:1788360822.944759:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360822.944781:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788360822.944786:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232143989504:0@lo:400: 00000100:00100000:2.0:1788360822.944806:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360822.944832:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232143989248:0@lo:400: 00000100:00100000:2.0:1788360822.944857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360822.944870:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232143989760:0@lo:400: 00000100:00100000:2.0:1788360822.944898:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360822.944912:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788360822.944916:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232143989376:0@lo:400: 00000100:00100000:2.0:1788360822.944933:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360822.944959:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143989632 00000100:00100000:2.0:1788360822.944965:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143989632 00000100:00100000:2.0:1788360822.945006:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143989248 00000100:00100000:2.0:1788360822.945009:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143989248 00000100:00100000:2.0:1788360822.945021:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143989376 00000100:00100000:2.0:1788360822.945023:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143989376 00000100:00100000:2.0:1788360822.945036:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788360822.945043:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232143989632:12345-0@lo:400: 00000100:00100000:2.0:1788360822.945113:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232143989632:12345-0@lo:400: Request processed in 69us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360822.945120:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788360822.945137:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788360822.945143:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232143989248:12345-0@lo:400: 00000100:00100000:2.0:1788360822.945176:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232143989248:12345-0@lo:400: Request processed in 34us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360822.945182:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788360822.945193:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788360822.945199:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232143989376:12345-0@lo:400: 00000100:00100000:2.0:1788360822.945224:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232143989376:12345-0@lo:400: Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360822.945229:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788360822.945267:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232143989376:0@lo:400: 00000100:00100000:2.0:1788360822.945278:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232143989248:0@lo:400: 00000100:00100000:2.0:1788360822.945329:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232143989632:0@lo:400: 00000100:00100000:2.0:1788360822.945364:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143989504 00000100:00100000:2.0:1788360822.945367:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143989504 00000100:00100000:2.0:1788360822.945396:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143989760 00000100:00100000:2.0:1788360822.945399:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143989760 00000100:00100000:2.0:1788360822.945413:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788360822.945419:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232143989504:12345-0@lo:400: 00000100:00100000:2.0:1788360822.945452:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232143989504:12345-0@lo:400: Request processed in 33us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360822.945458:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788360822.945469:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788360822.945474:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232143989760:12345-0@lo:400: 00000100:00100000:2.0:1788360822.945504:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232143989760:12345-0@lo:400: Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360822.945509:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788360822.945533:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab71b1180 x1875232143989760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360822.945543:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788360822.945554:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232143989760:0@lo:400: 00010000:00080000:2.0:1788360822.945584:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc433100 x1875232143989504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360822.945593:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232143989504:0@lo:400: 00000100:00080000:1.0:1788360822.945879:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788360822.945885:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788360822.945887:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360822.948252:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143989120 00000100:00100000:3.0:1788360822.948265:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143989120 00000100:00100000:3.0:1788360822.948316:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788360822.948325:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232143989120:12345-0@lo:400: 00000100:00100000:3.0:1788360822.948407:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232143989120:12345-0@lo:400: Request processed in 83us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360822.948414:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788360822.948479:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143989120:0@lo:400: 00000100:00100000:1.0:1788360822.948992:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232143989888:0@lo:13: 00000100:00100000:1.0:1788360822.949040:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360822.949138:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143989888 00000100:00100000:3.0:1788360822.949143:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143989888 00000100:00100000:3.0:1788360822.949172:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788360822.949179:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232143989888:12345-0@lo:13: 00002000:00000024:3.0:1788360822.949195:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788360822.949231:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232143989888:12345-0@lo:13: Request processed in 52us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360822.949237:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788360822.949363:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8986705880 x1875232143989888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360822.949380:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232143989888:0@lo:13: 00000100:00100000:2.0:1788360823.457843:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232143990016:0@lo:13: 00000100:00100000:2.0:1788360823.457908:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360823.458246:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143990016 00000100:00100000:3.0:1788360823.458255:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143990016 00000100:00100000:3.0:1788360823.458303:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788360823.458312:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232143990016:12345-0@lo:13: 00002000:00000024:3.0:1788360823.458344:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788360823.458387:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232143990016:12345-0@lo:13: Request processed in 76us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360823.458394:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788360823.458520:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a84939880 x1875232143990016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360823.458548:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232143990016:0@lo:13: 00010000:00010000:2.0:1788360823.522345:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788360823.539373:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000001:02000400:1.0:1788360823.990081:0:8150:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788360824.029311:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000100:00100000:0.0:1788360824.458312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360824.458372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360824.458402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360824.458453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360824.458628:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130338304 00000100:00100000:2.0:1788360824.458637:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130338304 00000100:00100000:2.0:1788360824.458692:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:2.0:1788360824.458702:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2350:x1875232130338304:12345-192.168.203.60@tcp:400: 00000100:00100000:2.0:1788360824.458771:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2350:x1875232130338304:12345-192.168.203.60@tcp:400: Request processed in 70us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360824.458778:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:2.0:1788360824.458810:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130338560 00000100:00100000:2.0:1788360824.458814:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130338560 00000100:00100000:2.0:1788360824.458854:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130338688 00000100:00100000:2.0:1788360824.458857:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130338688 00000100:00100000:2.0:1788360824.458873:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788360824.458878:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130338560:12345-192.168.203.60@tcp:400: 00000100:00100000:2.0:1788360824.458905:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130338560:12345-192.168.203.60@tcp:400: Request processed in 27us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360824.458910:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788360824.458921:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788360824.458927:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130338688:12345-192.168.203.60@tcp:400: 00000100:00100000:2.0:1788360824.458949:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130338688:12345-192.168.203.60@tcp:400: Request processed in 23us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360824.458955:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00080000:2.0:1788360824.459061:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788360824.459065:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788360824.459324:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130338432 00000100:00100000:1.0:1788360824.459329:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130338432 00000100:00100000:1.0:1788360824.459384:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1788360824.459393:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130338432:12345-192.168.203.60@tcp:400: 00000100:00100000:1.0:1788360824.459428:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130338432:12345-192.168.203.60@tcp:400: Request processed in 38us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360824.459434:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00080000:2.0:1788360824.460048:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788360824.546925:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360825.572315:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360826.592267:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788360826.925413:0:8298:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4cc46c60 20000000:00000080:0.0:1788360826.925431:0:8298:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8ab7472400 uarg=0000000000000000 20000000:01000000:0.0:1788360826.925466:0:8298:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788360826.925469:0:8298:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788360826.925471:0:8298:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788360826.925475:0:8298:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788360826.925480:0:8298:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788360826.925493:0:8298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788360826.925495:0:8298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788360826.925985:0:8298:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788360826.925988:0:8298:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788360826.933954:0:8299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788360826.935755:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788360826.936052:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788360826.936228:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788360826.936247:0:8298:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788360826.936249:0:8298:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788360826.937418:0:8300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788360826.938532:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788360826.938592:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788360826.938721:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788360826.938738:0:8298:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788360826.938741:0:8298:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788360826.940253:0:8301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788360826.940746:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788360826.941047:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788360826.941210:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788360826.941227:0:8298:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788360826.941230:0:8298:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788360826.943449:0:8302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788360826.944359:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788360826.944410:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788360826.944447:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1788360826.944465:0:8298:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788360826.944485:0:8298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944503:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1f200/0xf6a94c97d661013e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610137 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944510:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6610168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610161 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944516:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d6610192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661018b expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944523:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8aa8b44a00/0xf6a94c97d66101a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610199 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944530:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66101ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66101a7 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944537:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d66101ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66101c3 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944553:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66101f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66101ed expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944563:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a813cb200/0xf6a94c97d6610202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0b6 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944570:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d6610209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0bd expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944586:0:8298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944693:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d6610209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0bd expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.944708:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d6610209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0bd expref: 9 pid: 5792 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.944723:0:8298:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143990144:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360826.945052:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a813cb200/0xf6a94c97d6610202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0b6 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.945062:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a813cb200/0xf6a94c97d6610202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0b6 expref: 9 pid: 5791 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.945070:0:8298:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143990272:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360826.945231:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66101f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66101ed expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.945240:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66101f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66101ed expref: 18 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.945249:0:8298:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143990400:0@lo:104: 00000100:00100000:1.0:1788360826.945286:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788360826.945351:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d66101ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66101c3 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.945368:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d66101ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66101c3 expref: 18 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.945377:0:8298:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143990528:0@lo:104: 00000100:00100000:1.0:1788360826.945400:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788360826.945768:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66101ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66101a7 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.945777:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66101ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66101a7 expref: 18 pid: 5792 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.945785:0:8298:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143990656:0@lo:104: 00000100:00100000:2.0:1788360826.946262:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788360826.946280:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360826.946291:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143990400 00000100:00100000:2.0:1788360826.946297:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143990400 00000100:00100000:2.0:1788360826.946328:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143990528 00000100:00100000:2.0:1788360826.946330:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143990528 00000100:00100000:2.0:1788360826.946337:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143990656 00000100:00100000:2.0:1788360826.946339:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143990656 00000100:00100000:2.0:1788360826.946349:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788360826.946356:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:8298:x1875232143990400:12345-0@lo:104: 00010000:00010000:2.0:1788360826.946368:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.946443:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788360826.946449:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:8298:x1875232143990400:12345-0@lo:104: Request processed in 93us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360826.946456:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788360826.946471:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788360826.946476:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8927dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:8298:x1875232143990528:12345-0@lo:104: 00010000:00010000:2.0:1788360826.946483:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946539:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788360826.946557:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946565:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586a000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788360826.946569:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946577:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788360826.946585:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360826.946591:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788360826.946629:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946636:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788360826.946665:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946672:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586a000/0xf6a94c97d66101ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101f4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946684:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788360826.946687:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946693:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a813cb600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788360826.946696:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946704:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788360826.946710:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360826.946716:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788360826.946736:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946746:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788360826.946759:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946765:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a813cb600/0xf6a94c97d66101c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.946773:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360826.946779:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360826.946781:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360826.946793:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143990784:0@lo:103: 00000100:00100000:0.0:1788360826.947008:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360826.947044:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788360826.947050:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143990912:0@lo:103: 00000100:00100000:0.0:1788360826.947069:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360826.947105:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143990784 00000100:00100000:0.0:1788360826.947109:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143990784 00010000:00010000:0.0:1788360826.947128:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66101f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66101ed expref: 19 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360826.947146:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143990912 00000100:00100000:0.0:1788360826.947149:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143990912 00010000:00010000:0.0:1788360826.947159:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d66101ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66101c3 expref: 20 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360826.947176:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788360826.947182:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+20:3312:x1875232143990784:12345-0@lo:103: 00010000:00010000:0.0:1788360826.947192:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360826.947196:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66101f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66101ed expref: 20 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.947205:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66101f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66101ed expref: 20 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.947221:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360826.947248:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+20:3312:x1875232143990784:12345-0@lo:103: Request processed in 67us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360826.947254:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788360826.947276:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788360826.947281:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232143990912:12345-0@lo:103: 00010000:00010000:0.0:1788360826.947290:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360826.947294:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d66101ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66101c3 expref: 19 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.947301:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d66101ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66101c3 expref: 19 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.947310:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360826.947337:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232143990912:12345-0@lo:103: Request processed in 55us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360826.947343:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788360826.947387:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143990912:0@lo:103: 00000100:00100000:0.0:1788360826.947409:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232143990784:0@lo:103: 00010000:00010000:1.0:1788360826.947501:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8aa8b44a00/0xf6a94c97d66101a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6610199 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.947511:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8aa8b44a00/0xf6a94c97d66101a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6610199 expref: 18 pid: 5791 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.947520:0:8298:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143991040:0@lo:104: 00000100:00100000:1.0:1788360826.947556:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788360826.947632:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d6610192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661018b expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.947640:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d6610192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661018b expref: 18 pid: 5791 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.947648:0:8298:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143991168:0@lo:104: 00000100:00100000:1.0:1788360826.947669:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788360826.947720:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788360826.947727:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8927dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:8298:x1875232143990528:12345-0@lo:104: Request processed in 1250us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360826.947733:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788360826.947986:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6610168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6610161 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.947995:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6610168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6610161 expref: 18 pid: 5792 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.948003:0:8298:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143991296:0@lo:104: 00000100:00100000:1.0:1788360826.948022:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360826.948098:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143991040 00000100:00100000:2.0:1788360826.948102:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143991040 00000100:00100000:2.0:1788360826.948116:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143991168 00000100:00100000:2.0:1788360826.948118:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143991168 00000100:00100000:2.0:1788360826.948127:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788360826.948132:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:8298:x1875232143990656:12345-0@lo:104: 00010000:00010000:2.0:1788360826.948141:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948180:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788360826.948184:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:8298:x1875232143990656:12345-0@lo:104: Request processed in 53us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360826.948190:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788360826.948203:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788360826.948209:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:8298:x1875232143991040:12345-0@lo:104: 00010000:00010000:2.0:1788360826.948216:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948237:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788360826.948241:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:8298:x1875232143991040:12345-0@lo:104: Request processed in 34us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360826.948247:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788360826.948256:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788360826.948261:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:8298:x1875232143991168:12345-0@lo:104: 00010000:00010000:2.0:1788360826.948267:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948285:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788360826.948294:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:8298:x1875232143991168:12345-0@lo:104: Request processed in 33us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360826.948300:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788360826.948315:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788360826.948320:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948326:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360826.948330:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948338:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360826.948344:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360826.948350:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788360826.948365:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948371:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788360826.948381:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948388:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d66101a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948399:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788360826.948402:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948417:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a813cbc00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360826.948420:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948427:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360826.948433:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360826.948438:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788360826.948449:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948454:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788360826.948466:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948472:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a813cbc00/0xf6a94c97d6610199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66101a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948481:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360826.948484:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948489:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586aa00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360826.948492:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948508:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360826.948514:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360826.948519:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788360826.948531:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948537:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788360826.948553:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948560:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d661018b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610192 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.948570:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360826.948572:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360826.948573:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360826.948609:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788360826.948632:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143991424:0@lo:103: 00000100:00100000:2.0:1788360826.948660:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360826.948801:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143991552:0@lo:103: 00000100:00100000:0.0:1788360826.948993:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360826.949056:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788360826.949062:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143991680:0@lo:103: 00000100:00100000:0.0:1788360826.949082:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788360826.949156:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1f200/0xf6a94c97d661013e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6610137 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.949168:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a8df1f200/0xf6a94c97d661013e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6610137 expref: 18 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.949177:0:8298:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143991808:0@lo:104: 00000100:00100000:1.0:1788360826.949200:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360826.949224:0:8298:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7780 going to sleep for 11 seconds 00010000:00010000:1.0:1788360826.949245:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66101f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66101ed expref: 18 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.949256:0:8298:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143990400:0@lo:104: 00010000:00010000:1.0:1788360826.949264:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d66101ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66101c3 expref: 17 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.949271:0:8298:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143990528:0@lo:104: 00000100:00100000:1.0:1788360826.949278:0:8298:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143990656:0@lo:104: 00000100:00100000:1.0:1788360826.949284:0:8298:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143991040:0@lo:104: 00000100:00100000:1.0:1788360826.949293:0:8298:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143991168:0@lo:104: 00010000:00010000:1.0:1788360826.949331:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360826.949467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360826.949491:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143991424 00000100:00100000:2.0:1788360826.949498:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143991424 00010000:00010000:2.0:1788360826.949520:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66101ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66101a7 expref: 17 pid: 5792 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360826.949541:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143991552 00000100:00100000:2.0:1788360826.949553:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143991552 00010000:00010000:2.0:1788360826.949574:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8aa8b44a00/0xf6a94c97d66101a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610199 expref: 18 pid: 5791 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360826.949586:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143991680 00000100:00100000:2.0:1788360826.949589:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143991680 00010000:00010000:2.0:1788360826.949600:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d6610192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661018b expref: 19 pid: 5791 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360826.949802:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788360826.949828:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232143991424:12345-0@lo:103: 00010000:00010000:2.0:1788360826.949839:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360826.949862:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66101ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66101a7 expref: 19 pid: 5792 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.949872:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66101ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66101a7 expref: 19 pid: 5792 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.949886:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d66101ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66101a7 expref: 19 pid: 5792 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.949912:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360826.949977:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:3313:x1875232143991424:12345-0@lo:103: Request processed in 137us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360826.949984:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788360826.950000:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788360826.950005:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:3311:x1875232143991552:12345-0@lo:103: 00010000:00010000:2.0:1788360826.950012:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360826.950016:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8aa8b44a00/0xf6a94c97d66101a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610199 expref: 17 pid: 5791 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.950035:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8aa8b44a00/0xf6a94c97d66101a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6610199 expref: 17 pid: 5791 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.950045:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b44a00/0xf6a94c97d66101a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6610199 expref: 17 pid: 5791 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.950054:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360826.950082:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:3311:x1875232143991552:12345-0@lo:103: Request processed in 77us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360826.950133:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788360826.950150:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788360826.950156:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:3311:x1875232143991680:12345-0@lo:103: 00010000:00010000:2.0:1788360826.950163:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360826.950167:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d6610192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661018b expref: 15 pid: 5791 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.950175:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d6610192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661018b expref: 15 pid: 5791 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.950185:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d6610192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661018b expref: 15 pid: 5791 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.950193:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360826.950221:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:3311:x1875232143991680:12345-0@lo:103: Request processed in 65us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360826.950226:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788360826.950257:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143991424:0@lo:103: 00000100:00100000:2.0:1788360826.950277:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143991296 00000100:00100000:2.0:1788360826.950285:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143991296 00000100:00100000:2.0:1788360826.950300:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143991808 00000100:00100000:2.0:1788360826.950302:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143991808 00000100:00100000:2.0:1788360826.950311:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788360826.950317:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:8298:x1875232143991296:12345-0@lo:104: 00010000:00010000:2.0:1788360826.950327:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.950360:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788360826.950365:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:8298:x1875232143991296:12345-0@lo:104: Request processed in 49us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360826.950370:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788360826.950395:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788360826.950401:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:8298:x1875232143991808:12345-0@lo:104: 00010000:00010000:2.0:1788360826.950423:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.950466:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788360826.950487:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:8298:x1875232143991808:12345-0@lo:104: Request processed in 71us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360826.950492:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788360826.950522:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788360826.950527:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.950533:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360826.950537:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.950576:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360826.950583:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360826.950589:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788360826.951016:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.951024:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788360826.951042:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.951049:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45000/0xf6a94c97d6610161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610168 expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.951059:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360826.951062:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.951068:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fc00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360826.951071:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.951078:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360826.951103:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360826.951115:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788360826.951130:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.951136:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788360826.951168:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.951176:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d6610137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661013e expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360826.951213:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360826.951215:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360826.951217:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360826.951253:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143992064:0@lo:103: 00000100:00100000:0.0:1788360826.951460:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143991680:0@lo:103: 00000100:00100000:0.0:1788360826.951484:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143991552:0@lo:103: 00000100:00100000:2.0:1788360826.952808:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143991936:0@lo:103: 00000100:00100000:0.0:1788360826.953011:0:8298:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143990144:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360826.953023:0:8298:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143990272:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360826.953032:0:8298:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143991296:0@lo:104: 00000100:00100000:0.0:1788360826.953055:0:8298:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1875232143991808:0@lo:104: 00010000:00010000:0.0:1788360826.953110:0:8298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360826.953213:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788360826.953335:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360826.954398:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143991936 00000100:00100000:0.0:1788360826.954410:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143991936 00010000:00010000:0.0:1788360826.954452:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6610168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610161 expref: 14 pid: 5792 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.954470:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130338944 00000100:00100000:1.0:1788360826.954476:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130338944 00000100:00100000:0.0:1788360826.954487:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788360826.954498:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:3313:x1875232143991936:12345-0@lo:103: 00000100:00100000:3.0:1788360826.954507:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1788360826.954512:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360826.954519:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6610168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610161 expref: 14 pid: 5792 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.954528:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a813cb200/0xf6a94c97d6610202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0b6 expref: 10 pid: 5791 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.954534:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6610168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6610161 expref: 14 pid: 5792 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360826.954535:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130338816 00000100:00100000:3.0:1788360826.954540:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130338816 00010000:00010000:0.0:1788360826.954568:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6610168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6610161 expref: 14 pid: 5792 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.954569:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00010000:00010000:3.0:1788360826.954570:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d6610209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0bd expref: 11 pid: 5792 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.954580:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:2349:x1875232130338944:12345-192.168.203.60@tcp:103: 00010000:00010000:1.0:1788360826.954593:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788360826.954596:0:7487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:1.0:1788360826.954598:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a813cb200/0xf6a94c97d6610202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0b6 expref: 11 pid: 5791 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.954599:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788360826.954610:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a813cb200/0xf6a94c97d6610202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0b6 expref: 11 pid: 5791 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360826.954613:0:7487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1788360826.954622:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813cb200/0xf6a94c97d6610202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0b6 expref: 11 pid: 5791 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.954636:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360826.954650:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3313:x1875232143991936:12345-0@lo:103: Request processed in 153us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360826.954656:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788360826.954675:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788360826.954683:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2349:x1875232130338816:12345-192.168.203.60@tcp:103: 00010000:00010000:0.0:1788360826.954692:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788360826.954693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788360826.954699:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d6610209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0bd expref: 10 pid: 5792 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.954716:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d6610209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0bd expref: 10 pid: 5792 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.954727:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d6610209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0bd expref: 10 pid: 5792 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360826.954736:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360826.954884:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232143991936:0@lo:103: 00000100:00100000:1.0:1788360826.954887:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:2349:x1875232130338944:12345-192.168.203.60@tcp:103: Request processed in 307us (5431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360826.954897:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1788360826.954987:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143992064 00000100:00100000:1.0:1788360826.954992:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143992064 00010000:00010000:1.0:1788360826.955006:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1f200/0xf6a94c97d661013e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610137 expref: 13 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360826.955029:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788360826.955034:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84edb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3314:x1875232143992064:12345-0@lo:103: 00010000:00010000:1.0:1788360826.955041:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360826.955050:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1f200/0xf6a94c97d661013e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610137 expref: 13 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955058:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1f200/0xf6a94c97d661013e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6610137 expref: 13 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955068:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1f200/0xf6a94c97d661013e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6610137 expref: 13 pid: 5789 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955078:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955110:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955153:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955162:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955170:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955176:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955183:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a813ca000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788360826.955186:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955194:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955218:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955228:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360826.955262:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84edb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+12:3314:x1875232143992064:12345-0@lo:103: Request processed in 227us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360826.955268:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1788360826.955332:0:8298:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955341:0:8298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360826.955347:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813ca000/0xf6a94c97d6610241 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360826.955383:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143992064:0@lo:103: 00000100:00100000:0.0:1788360826.957425:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:2349:x1875232130338816:12345-192.168.203.60@tcp:103: Request processed in 2729us (2907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360826.957439:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788360827.265312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360827.265415:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130339072 00000100:00100000:0.0:1788360827.265426:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130339072 00000100:00100000:0.0:1788360827.265481:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:0.0:1788360827.265489:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:5562:x1875232130339072:12345-192.168.203.60@tcp:101: 00010000:00010000:0.0:1788360827.265505:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360827.265526:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586a000/0xf6a94c97d6610248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e11f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360827.265671:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586a000/0xf6a94c97d6610248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e11f expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360827.265685:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586a000/0xf6a94c97d6610248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e11f expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360827.265695:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586a000, rc 0) 00000100:00100000:0.0:1788360827.265757:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5562:x1875232130339072:12345-192.168.203.60@tcp:101: Request processed in 267us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360827.265779:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:2.0:1788360827.269302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360827.269761:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130339200 00000100:00100000:0.0:1788360827.269771:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130339200 00000100:00100000:2.0:1788360827.269899:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:2.0:1788360827.269910:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5562:x1875232130339200:12345-192.168.203.60@tcp:501: 00000100:00100000:2.0:1788360827.270258:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5562:x1875232130339200:12345-192.168.203.60@tcp:501: Request processed in 349us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360827.270277:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:1.0:1788360827.276156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360827.276872:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130339328 00000100:00100000:0.0:1788360827.276883:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130339328 00000100:00100000:0.0:1788360827.276940:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:0.0:1788360827.276948:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5562:x1875232130339328:12345-192.168.203.60@tcp:503: 00000100:00100000:0.0:1788360827.277192:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5562:x1875232130339328:12345-192.168.203.60@tcp:503: Request processed in 243us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360827.277732:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:3.0:1788360827.280749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360827.281245:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130339456 00000100:00100000:0.0:1788360827.281256:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130339456 00000100:00100000:0.0:1788360827.281355:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:0.0:1788360827.281366:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:6030:x1875232130339456:12345-192.168.203.60@tcp:502: 00000100:00100000:0.0:1788360827.281656:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:6030:x1875232130339456:12345-192.168.203.60@tcp:502: Request processed in 285us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360827.281664:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:1.0:1788360827.284444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360827.284532:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130339584 00000100:00100000:0.0:1788360827.284550:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130339584 00000100:00100000:0.0:1788360827.284602:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:0.0:1788360827.284612:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:6030:x1875232130339584:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788360827.285810:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:6030:x1875232130339584:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 1194us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360827.285821:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:1.0:1788360827.296941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360827.297340:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130339712 00000100:00100000:0.0:1788360827.297364:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130339712 00000100:00100000:0.0:1788360827.297457:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:0.0:1788360827.297467:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5562:x1875232130339712:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788360827.297484:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360827.297502:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661024f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e126 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360827.297532:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661024f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e126 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360827.297552:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661024f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e126 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360827.297563:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586bc00, rc 0) 00000100:00100000:0.0:1788360827.297624:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5562:x1875232130339712:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 158us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360827.297631:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:3.0:1788360827.300023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360827.300259:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130339840 00000100:00100000:0.0:1788360827.300278:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130339840 00000100:00100000:0.0:1788360827.300330:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:0.0:1788360827.300338:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5562:x1875232130339840:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360827.300613:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5562:x1875232130339840:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 275us (598us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788360827.300621:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00010000:00010000:2.0:1788360827.616552:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360828.064431:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788360828.064457:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232143992192:0@lo:13: 00000100:00100000:1.0:1788360828.064524:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360828.064875:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143992192 00000100:00100000:3.0:1788360828.064884:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143992192 00000100:00100000:3.0:1788360828.064954:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788360828.064964:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232143992192:12345-0@lo:13: 10000000:01000000:2.0:1788360828.064974:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788360828.064978:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a898534c800 from 39 10000000:01000000:2.0:1788360828.064981:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00002000:00000024:3.0:1788360828.064997:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00010000:2.0:1788360828.065010:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.065020:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.065029:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360828.065037:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232143992192:12345-0@lo:13: Request processed in 75us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.065043:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143992320:0@lo:101: 00000100:00100000:3.0:1788360828.065044:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788360828.065073:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360828.065110:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788360828.065120:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788360828.065128:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143992448:0@lo:400: 00000100:00100000:2.0:1788360828.065152:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360828.065171:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232143992576:0@lo:400: 00000100:00100000:3.0:1788360828.065191:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232143992704:0@lo:400: 00000100:00100000:2.0:1788360828.065195:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360828.065215:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.065264:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143992320 00000100:00100000:0.0:1788360828.065268:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143992320 00000100:00100000:0.0:1788360828.065293:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143992448 00000100:00100000:0.0:1788360828.065296:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143992448 00000100:00100000:0.0:1788360828.065318:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788360828.065323:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143992320:12345-0@lo:101: 00010000:00010000:0.0:1788360828.065331:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360828.065343:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586a800/0xf6a94c97d661025d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610256 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.065363:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586a800/0xf6a94c97d661025d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610256 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.065373:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586a800/0xf6a94c97d661025d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610256 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.065381:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586a800, rc 0) 00000100:00100000:0.0:1788360828.065413:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143992320:12345-0@lo:101: Request processed in 90us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.065419:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788360828.065442:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788360828.065447:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3311:x1875232143992448:12345-0@lo:400: 00000100:00100000:0.0:1788360828.065471:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:3311:x1875232143992448:12345-0@lo:400: Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.065476:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1788360828.065710:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788360828.065724:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232143992960:0@lo:400: 00000100:00100000:1.0:1788360828.065752:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788360828.065795:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8986706a00 x1875232143992192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360828.065898:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143992960 00000100:00100000:0.0:1788360828.065904:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143992960 00000100:00100000:0.0:1788360828.065938:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788360828.065944:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232143992960:12345-0@lo:400: 00000100:00100000:0.0:1788360828.065977:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232143992960:12345-0@lo:400: Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.065984:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788360828.066012:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788360828.066031:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232143992832:0@lo:400: 00000100:00100000:0.0:1788360828.066056:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.066104:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232143992192:0@lo:13: 00010000:00080000:1.0:1788360828.066157:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a84938000 x1875232143992960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360828.066166:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232143992960:0@lo:400: 00000100:00100000:1.0:1788360828.066196:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143992320:0@lo:101: 00010000:00010000:1.0:1788360828.066211:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.066221:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360828.066267:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143993088:0@lo:501: 00000100:00100000:1.0:1788360828.066292:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.066305:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360828.066321:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143993088 00000100:00100000:1.0:1788360828.066324:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143993088 00000100:00100000:1.0:1788360828.066348:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788360828.066354:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143993088:12345-0@lo:501: 00000100:00100000:1.0:1788360828.066815:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143993088:12345-0@lo:501: Request processed in 448us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.066822:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788360828.066859:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143993088:0@lo:501: 00000100:00100000:1.0:1788360828.066889:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143993216:0@lo:503: 00000100:00100000:1.0:1788360828.066924:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.066944:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360828.066964:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143993216 00000100:00100000:1.0:1788360828.066977:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143993216 00000100:00100000:1.0:1788360828.066999:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788360828.067005:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143993216:12345-0@lo:503: 00000100:00100000:1.0:1788360828.067150:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143993216:12345-0@lo:503: Request processed in 144us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.067157:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788360828.067189:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143993216:0@lo:503: 00000100:00100000:1.0:1788360828.067388:0:8315:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8315:1875232143993344:0@lo:502: 00000100:00100000:1.0:1788360828.067424:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.067442:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143993344 00000100:00100000:1.0:1788360828.067446:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143993344 00000100:00100000:1.0:1788360828.067467:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788360828.067473:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:8315:x1875232143993344:12345-0@lo:502: 00000100:00100000:1.0:1788360828.068379:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:8315:x1875232143993344:12345-0@lo:502: Request processed in 902us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.068387:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788360828.068429:0:8315:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788360828.068445:0:8315:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8315:1875232143993344:0@lo:502: 00000100:00100000:1.0:1788360828.068492:0:8315:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8315:1875232143993472:0@lo:502: 00000100:00100000:1.0:1788360828.068524:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.068558:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143993472 00000100:00100000:1.0:1788360828.068562:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143993472 00000100:00100000:1.0:1788360828.068994:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788360828.069001:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:8315:x1875232143993472:12345-0@lo:502: 00000100:00100000:1.0:1788360828.069198:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:8315:x1875232143993472:12345-0@lo:502: Request processed in 197us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.069211:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788360828.069241:0:8315:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788360828.069254:0:8315:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8315:1875232143993472:0@lo:502: 00000040:00080000:1.0:1788360828.069275:0:8315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788360828.069328:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788360828.069343:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788360828.069352:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.069361:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360828.069370:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788360828.069372:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788360828.069375:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788360828.069398:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.069406:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.069415:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360828.069427:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143993600:0@lo:101: 00000100:00100000:1.0:1788360828.069453:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.069468:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788360828.069479:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143993600 00000100:00100000:1.0:1788360828.069483:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143993600 00000100:00100000:1.0:1788360828.069512:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788360828.069518:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+13:5794:x1875232143993600:12345-0@lo:101: 00010000:00010000:1.0:1788360828.069526:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360828.069550:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d661026b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610264 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.069966:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143992448:0@lo:400: 00000100:00100000:2.0:1788360828.072951:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143992576 00000100:00100000:0.0:1788360828.072951:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143992704 00000100:00100000:2.0:1788360828.072965:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143992576 00000100:00100000:0.0:1788360828.072965:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143992704 00000100:00100000:0.0:1788360828.073032:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143992832 00000100:00100000:0.0:1788360828.073036:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143992832 00000100:00100000:2.0:1788360828.073040:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788360828.073050:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232143992576:12345-0@lo:400: 00000100:00100000:0.0:1788360828.073064:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788360828.073073:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232143992704:12345-0@lo:400: 00000100:00100000:2.0:1788360828.073153:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232143992576:12345-0@lo:400: Request processed in 104us (7956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.073174:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788360828.073190:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788360828.073196:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232143992832:12345-0@lo:400: 00000100:00100000:2.0:1788360828.073233:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232143992832:12345-0@lo:400: Request processed in 37us (7176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.073238:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788360828.073294:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232143992576:0@lo:400: 00000100:00100000:0.0:1788360828.073310:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232143992704:12345-0@lo:400: Request processed in 236us (8092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.073317:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788360828.073336:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232143992832:0@lo:400: 00000100:00080000:0.0:1788360828.073340:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360828.073370:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232143992704:0@lo:400: 00010000:00010000:1.0:1788360828.074412:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d661026b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610264 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.074432:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d661026b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610264 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.074443:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813ca800, rc 0) 00000100:00100000:1.0:1788360828.074499:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143993600:12345-0@lo:101: Request processed in 4981us (5045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.074507:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788360828.074652:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143993600:0@lo:101: 00010000:00010000:0.0:1788360828.074671:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.074683:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.074749:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143993728:0@lo:501: 00000100:00100000:0.0:1788360828.074792:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.074826:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788360828.075050:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143993728 00000100:00100000:2.0:1788360828.075055:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143993728 00000100:00100000:2.0:1788360828.075116:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788360828.075124:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143993728:12345-0@lo:501: 00000100:00100000:2.0:1788360828.075373:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143993728:12345-0@lo:501: Request processed in 249us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.075380:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788360828.075673:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143993728:0@lo:501: 00000100:00100000:1.0:1788360828.075704:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143993856:0@lo:503: 00000100:00100000:1.0:1788360828.075740:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.075772:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.076995:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143993856 00000100:00100000:0.0:1788360828.077005:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143993856 00000100:00100000:0.0:1788360828.077082:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788360828.077127:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143993856:12345-0@lo:503: 00000100:00100000:0.0:1788360828.077317:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143993856:12345-0@lo:503: Request processed in 192us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.077325:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788360828.077666:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143993856:0@lo:503: 00000100:00100000:0.0:1788360828.079030:0:8316:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8316:1875232143993984:0@lo:502: 00000100:00100000:0.0:1788360828.079121:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.079149:0:8316:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360828.079238:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143993984 00000100:00100000:1.0:1788360828.079244:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143993984 00000100:00100000:1.0:1788360828.079275:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788360828.079282:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:8316:x1875232143993984:12345-0@lo:502: 00000100:00100000:1.0:1788360828.079464:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:8316:x1875232143993984:12345-0@lo:502: Request processed in 182us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.079471:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788360828.079559:0:8316:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8316:1875232143993984:0@lo:502: 00000020:01000000:3.0:1788360828.079649:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788360828.079658:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788360828.079660:0:8316:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788360828.079665:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788360828.079687:0:8316:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8316:1875232143994112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788360828.079719:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360828.079780:0:8316:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788360828.081706:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143994112 00000100:00100000:1.0:1788360828.081731:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143994112 00000100:00100000:1.0:1788360828.081773:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788360828.081780:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:8316:x1875232143994112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360828.081999:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:8316:x1875232143994112:12345-0@lo:502:llog_process_th.0 Request processed in 218us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.082006:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788360828.082167:0:8316:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8316:1875232143994112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788360828.082197:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788360828.082204:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788360828.082211:0:8316:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788360828.082216:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788360828.082395:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788360828.082414:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788360828.082424:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.082435:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360828.082445:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788360828.082447:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a86b49000 from 39 10000000:01000000:1.0:1788360828.082460:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788360828.082486:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.082494:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.082504:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360828.082522:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143994240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788360828.082575:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.082604:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788360828.082974:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143994240 00000100:00100000:2.0:1788360828.082980:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143994240 00000100:00100000:2.0:1788360828.083017:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788360828.083025:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:5794:x1875232143994240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360828.083035:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360828.083047:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d6610279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610272 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.083070:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d6610279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610272 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.083119:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d6610279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610272 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.083127:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:2.0:1788360828.083171:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143994240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.083178:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788360828.083207:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143994240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788360828.083220:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.083229:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360828.083274:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143994368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360828.083300:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.083327:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.083381:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143994368 00000100:00100000:0.0:1788360828.083385:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143994368 00000100:00100000:0.0:1788360828.083415:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788360828.083422:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143994368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.083771:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143994368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.083778:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788360828.085013:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143994368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360828.085270:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143994496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360828.085327:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.085361:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788360828.085463:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143994496 00000100:00100000:2.0:1788360828.085469:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143994496 00000100:00100000:2.0:1788360828.085532:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788360828.085552:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143994496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788360828.085788:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143994496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.085795:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788360828.085936:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143994496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360828.086747:0:8317:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8317:1875232143994624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360828.086794:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.086835:0:8317:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.086934:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143994624 00000100:00100000:0.0:1788360828.086940:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143994624 00000100:00100000:0.0:1788360828.086976:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788360828.086984:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:8317:x1875232143994624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.087465:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:8317:x1875232143994624:12345-0@lo:502:llog_process_th.0 Request processed in 481us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.087473:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788360828.087601:0:8317:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8317:1875232143994624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360828.087643:0:8317:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8317:1875232143994752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360828.087674:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360828.087696:0:8317:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.087795:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143994752 00000100:00100000:0.0:1788360828.087800:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143994752 00000100:00100000:0.0:1788360828.087900:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788360828.087907:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:8317:x1875232143994752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.088061:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:8317:x1875232143994752:12345-0@lo:502:llog_process_th.0 Request processed in 154us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.088068:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788360828.088366:0:8317:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8317:1875232143994752:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788360828.088386:0:8317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788360828.088546:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788360828.088633:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788360828.088643:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.088654:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360828.088665:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788360828.088667:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788360828.088671:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788360828.088695:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.088702:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.088711:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.088725:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143994880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.088756:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.088786:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788360828.088902:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143994880 00000100:00100000:1.0:1788360828.088907:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143994880 00000100:00100000:1.0:1788360828.088970:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788360828.088978:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+15:5794:x1875232143994880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788360828.088987:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360828.088998:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d6610287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610280 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.089019:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d6610287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610280 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.089029:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d6610287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610280 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.089038:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813cb600, rc 0) 00000100:00100000:1.0:1788360828.089100:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143994880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.089107:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788360828.089382:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143994880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788360828.089395:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.089411:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.089458:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143995008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.089482:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.089508:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788360828.089556:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143995008 00000100:00100000:1.0:1788360828.089561:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143995008 00000100:00100000:1.0:1788360828.089630:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788360828.089637:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143995008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360828.089865:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143995008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.089872:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788360828.090069:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143995008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.090136:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143995136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.090173:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.090690:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788360828.090728:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143995136 00000100:00100000:2.0:1788360828.090734:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143995136 00000100:00100000:2.0:1788360828.090764:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788360828.090771:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143995136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788360828.090945:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143995136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.090952:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788360828.091502:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143995136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.091774:0:8318:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8318:1875232143995264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.091825:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.091850:0:8318:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788360828.092004:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143995264 00000100:00100000:2.0:1788360828.092010:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143995264 00000100:00100000:2.0:1788360828.092035:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788360828.092041:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:8318:x1875232143995264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788360828.092286:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:8318:x1875232143995264:12345-0@lo:502:llog_process_th.0 Request processed in 243us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.092298:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788360828.092526:0:8318:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8318:1875232143995264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788360828.092561:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788360828.092639:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360828.092642:0:8318:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788360828.092651:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788360828.092672:0:8318:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8318:1875232143995392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.092704:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.092733:0:8318:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360828.092780:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143995392 00000100:00100000:2.0:1788360828.092784:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143995392 00000100:00100000:2.0:1788360828.092904:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788360828.092912:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:8318:x1875232143995392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788360828.093041:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:8318:x1875232143995392:12345-0@lo:502:llog_process_th.0 Request processed in 130us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.093057:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788360828.093135:0:8318:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8318:1875232143995392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788360828.093162:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360828.093166:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360828.093168:0:8318:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788360828.093172:0:8318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788360828.093221:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788360828.093238:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788360828.093247:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.093257:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360828.093267:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788360828.093269:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a83778000 from 39 10000000:01000000:0.0:1788360828.093272:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788360828.093292:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.093300:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.093309:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.093321:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143995520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.093346:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.093784:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360828.093980:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143995520 00000100:00100000:3.0:1788360828.093986:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143995520 00000100:00100000:3.0:1788360828.094015:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788360828.094021:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143995520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788360828.094032:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360828.094055:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1ea00/0xf6a94c97d6610295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661028e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.094077:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1ea00/0xf6a94c97d6610295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661028e expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.094109:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1ea00/0xf6a94c97d6610295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661028e expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.094293:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ea00, rc 0) 00000100:00100000:3.0:1788360828.094340:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143995520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 318us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360828.094346:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788360828.094436:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143995520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788360828.094451:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.094469:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.094521:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143995648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.094559:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.094586:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.094599:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143995648 00000100:00100000:0.0:1788360828.094602:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143995648 00000100:00100000:0.0:1788360828.094619:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788360828.094625:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143995648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.094846:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143995648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.094853:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788360828.094882:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143995648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.094908:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143995776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.094943:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.094955:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.094966:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143995776 00000100:00100000:0.0:1788360828.094969:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143995776 00000100:00100000:0.0:1788360828.094984:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788360828.094990:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143995776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.095161:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143995776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.095167:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788360828.095204:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143995776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.095359:0:8319:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8319:1875232143995904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.095390:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.095407:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143995904 00000100:00100000:0.0:1788360828.095410:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143995904 00000100:00100000:0.0:1788360828.095425:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788360828.095430:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:8319:x1875232143995904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.095576:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:8319:x1875232143995904:12345-0@lo:502:llog_process_th.0 Request processed in 145us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.095582:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788360828.095607:0:8319:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.095617:0:8319:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8319:1875232143995904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.095651:0:8319:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8319:1875232143996032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.095680:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.095696:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143996032 00000100:00100000:0.0:1788360828.095699:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143996032 00000100:00100000:0.0:1788360828.095715:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788360828.095720:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:8319:x1875232143996032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.095829:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:8319:x1875232143996032:12345-0@lo:502:llog_process_th.0 Request processed in 108us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.095835:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788360828.095860:0:8319:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.095871:0:8319:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8319:1875232143996032:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788360828.095889:0:8319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788360828.095935:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788360828.095949:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788360828.095957:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.095967:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360828.095975:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788360828.095978:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788360828.095980:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788360828.096001:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.096009:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.096017:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.096029:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143996160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.096054:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.096066:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.096076:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143996160 00000100:00100000:0.0:1788360828.096079:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143996160 00000100:00100000:0.0:1788360828.096115:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788360828.096121:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143996160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788360828.096129:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360828.096139:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586aa00/0xf6a94c97d66102a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661029c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.096169:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586aa00/0xf6a94c97d66102a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661029c expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.096179:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586aa00/0xf6a94c97d66102a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661029c expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.096187:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586aa00, rc 0) 00000100:00100000:0.0:1788360828.096215:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143996160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.096220:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788360828.096247:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143996160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788360828.096257:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.096265:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.096300:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143996288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.096321:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.096332:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.096341:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143996288 00000100:00100000:0.0:1788360828.096343:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143996288 00000100:00100000:0.0:1788360828.096357:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788360828.096361:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143996288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.096522:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143996288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.096552:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788360828.096579:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143996288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.096601:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143996416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.096630:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.096642:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.096652:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143996416 00000100:00100000:0.0:1788360828.096655:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143996416 00000100:00100000:0.0:1788360828.096668:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788360828.096673:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143996416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.096782:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143996416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.096788:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788360828.096821:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143996416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.097061:0:8320:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8320:1875232143996544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.097112:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.097127:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143996544 00000100:00100000:0.0:1788360828.097130:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143996544 00000100:00100000:0.0:1788360828.097145:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788360828.097150:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8320:x1875232143996544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.097286:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8320:x1875232143996544:12345-0@lo:502:llog_process_th.0 Request processed in 135us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.097292:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788360828.097316:0:8320:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.097328:0:8320:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8320:1875232143996544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788360828.097353:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788360828.097360:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360828.097362:0:8320:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788360828.097371:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788360828.097389:0:8320:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8320:1875232143996672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360828.097420:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.097438:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143996672 00000100:00100000:0.0:1788360828.097442:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143996672 00000100:00100000:0.0:1788360828.097457:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788360828.097463:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8320:x1875232143996672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360828.098216:0:8320:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360828.098475:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8320:x1875232143996672:12345-0@lo:502:llog_process_th.0 Request processed in 1010us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.098484:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788360828.098551:0:8320:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8320:1875232143996672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788360828.098579:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788360828.098591:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360828.098592:0:8320:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788360828.098597:0:8320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788360828.098752:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788360828.098770:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788360828.098779:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.098789:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360828.098799:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788360828.098802:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a8a85713380 from 1 10000000:01000000:0.0:1788360828.098804:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788360828.098828:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b000/0xf6a94c97d66102aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.098836:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586b000/0xf6a94c97d66102aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.098857:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586b000/0xf6a94c97d66102aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.098873:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143996800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.098901:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.098955:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788360828.098987:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143996800 00000100:00100000:1.0:1788360828.098993:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143996800 00000100:00100000:1.0:1788360828.099070:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788360828.099078:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143996800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788360828.099119:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360828.099133:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813cbc00/0xf6a94c97d66102b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66102aa expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.099156:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813cbc00/0xf6a94c97d66102b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66102aa expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.099167:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813cbc00/0xf6a94c97d66102b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66102aa expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360828.099175:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813cbc00, rc 0) 00000100:00100000:1.0:1788360828.099210:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143996800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.099216:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788360828.099280:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143996800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788360828.099292:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586b000/0xf6a94c97d66102aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.099300:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586b000/0xf6a94c97d66102aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66102b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.099343:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143996928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.099368:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360828.099579:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788360828.099631:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143996928 00000100:00100000:2.0:1788360828.099637:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143996928 00000100:00100000:2.0:1788360828.099659:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788360828.099666:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143996928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788360828.099909:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143996928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (539us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788360828.099916:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788360828.100002:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143996928:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788360828.100025:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788360828.100301:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b000/0xf6a94c97d66102aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.100311:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586b000/0xf6a94c97d66102aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360828.582977:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788360828.583000:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232143997056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788360828.583068:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360828.583151:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143997056 00000100:00100000:3.0:1788360828.583158:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143997056 00000100:00100000:3.0:1788360828.583204:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788360828.583213:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232143997056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788360828.583246:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788360828.583289:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232143997056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360828.583303:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788360828.583348:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a84939c00 x1875232143997056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360828.583368:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232143997056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788360828.640378:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788360828.781960:0:8357:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccff746b0 20000000:00000080:1.0:1788360828.781977:0:8357:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8a8927f000 uarg=0000000000000000 20000000:01000000:1.0:1788360828.782014:0:8357:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788360828.782019:0:8357:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788360828.782024:0:8357:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788360828.782895:0:8358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788360828.783051:0:8357:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788360828.786929:0:8357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788360828.786985:0:8357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788360828.787049:0:8357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788360828.787064:0:8357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788360828.787080:0:8357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.788928:0:8357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a80030200/0xf6a94c97d6610081 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661007a expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.788938:0:8357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d66100ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66100f1 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.788945:0:8357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d661015a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610153 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.788954:0:8357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0ee expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.788962:0:8357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.789003:0:8357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0ee expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.789021:0:8357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610217 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0ee expref: 9 pid: 5792 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.789040:0:8357:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8357:1875232143997184:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360828.789772:0:8357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d661015a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6610153 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.789783:0:8357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d661015a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6610153 expref: 18 pid: 5792 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.789817:0:8357:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8357:1875232143997312:0@lo:104: 00000100:00100000:0.0:1788360828.789861:0:8357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788360828.789901:0:8357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d66100ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66100f1 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.789910:0:8357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d66100ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66100f1 expref: 18 pid: 5791 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.789919:0:8357:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8357:1875232143997440:0@lo:104: 00000100:00100000:0.0:1788360828.789943:0:8357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788360828.789974:0:8357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a80030200/0xf6a94c97d6610081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661007a expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.789982:0:8357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a80030200/0xf6a94c97d6610081 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661007a expref: 18 pid: 5792 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.789990:0:8357:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8357:1875232143997568:0@lo:104: 00000100:00100000:0.0:1788360828.790005:0:8357:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788360828.790071:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788360828.790114:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360828.790126:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143997312 00000100:00100000:2.0:1788360828.790132:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143997312 00000100:00100000:2.0:1788360828.790166:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143997440 00000100:00100000:2.0:1788360828.790169:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143997440 00000100:00100000:2.0:1788360828.790177:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143997568 00000100:00100000:2.0:1788360828.790179:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143997568 00000100:00100000:2.0:1788360828.790191:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788360828.790199:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:8357:x1875232143997312:12345-0@lo:104: 00010000:00010000:2.0:1788360828.790210:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790273:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788360828.790279:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:8357:x1875232143997312:12345-0@lo:104: Request processed in 81us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.790287:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788360828.790303:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788360828.790309:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abfe76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:8357:x1875232143997440:12345-0@lo:104: 00010000:00010000:2.0:1788360828.790316:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790344:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788360828.790349:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abfe76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:8357:x1875232143997440:12345-0@lo:104: Request processed in 40us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.790354:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788360828.790390:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788360828.790395:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:8357:x1875232143997568:12345-0@lo:104: 00010000:00010000:2.0:1788360828.790402:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d661007a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790424:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788360828.790429:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:8357:x1875232143997568:12345-0@lo:104: Request processed in 34us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.790434:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788360828.790449:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788360828.790454:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790461:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360828.790470:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790479:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360828.790486:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360828.790492:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788360828.790515:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790523:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788360828.790554:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790561:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6610153 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661015a expref: -99 pid: 7480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790575:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788360828.790578:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790585:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360828.790587:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790593:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360828.790608:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360828.790613:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788360828.790627:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790633:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788360828.790647:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790653:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44800/0xf6a94c97d66100f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66100ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790663:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360828.790666:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d661007a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790672:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a813ca200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360828.790675:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d661007a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790681:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d661007a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360828.790688:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d661007a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360828.790693:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788360828.790712:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d661007a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790717:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788360828.790723:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d661007a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790730:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d661007a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610081 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.790743:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360828.790745:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360828.790746:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360828.790753:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360828.790763:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143997696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788360828.790790:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360828.790822:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143997824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788360828.790844:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360828.790862:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788360828.790868:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143997952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788360828.790887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360828.790913:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143997696 00000100:00100000:2.0:1788360828.790917:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143997696 00010000:00010000:2.0:1788360828.790935:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d661015a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610153 expref: 19 pid: 5792 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360828.790952:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143997824 00000100:00100000:2.0:1788360828.790955:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143997824 00010000:00010000:2.0:1788360828.790964:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d66100ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66100f1 expref: 20 pid: 5791 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360828.790989:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143997952 00000100:00100000:2.0:1788360828.790992:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143997952 00010000:00010000:2.0:1788360828.791002:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a80030200/0xf6a94c97d6610081 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661007a expref: 21 pid: 5792 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360828.791011:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788360828.791018:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9fa3464-d771-4fa1-895d-6f4c1383568d+21:3314:x1875232143997696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788360828.791027:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360828.791033:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d661015a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610153 expref: 21 pid: 5792 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.791040:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d661015a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6610153 expref: 21 pid: 5792 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.791054:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360828.791081:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9fa3464-d771-4fa1-895d-6f4c1383568d+21:3314:x1875232143997696:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.791121:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788360828.791136:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788360828.791142:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9fa3464-d771-4fa1-895d-6f4c1383568d+20:3311:x1875232143997824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788360828.791149:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360828.791153:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d66100ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66100f1 expref: 20 pid: 5791 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.791161:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d66100ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66100f1 expref: 20 pid: 5791 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.791170:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360828.791202:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9fa3464-d771-4fa1-895d-6f4c1383568d+20:3311:x1875232143997824:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.791208:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788360828.791220:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788360828.791225:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232143997952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788360828.791232:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360828.791236:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a80030200/0xf6a94c97d6610081 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661007a expref: 19 pid: 5792 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.791244:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a80030200/0xf6a94c97d6610081 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661007a expref: 19 pid: 5792 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360828.791253:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360828.791274:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232143997952:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360828.791280:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788360828.791342:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232143997696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788360828.791364:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143997952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788360828.791371:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232143997824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788360828.791549:0:8357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d661015a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6610153 expref: 18 pid: 5792 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.791559:0:8357:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8357:1875232143997312:0@lo:104: 00010000:00010000:0.0:1788360828.791569:0:8357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d66100ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66100f1 expref: 17 pid: 5791 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.791577:0:8357:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8357:1875232143997440:0@lo:104: 00010000:00010000:0.0:1788360828.791586:0:8357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a80030200/0xf6a94c97d6610081 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661007a expref: 16 pid: 5792 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360828.791607:0:8357:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8357:1875232143997568:0@lo:104: 00000100:00100000:0.0:1788360828.795874:0:8357:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8357:1875232143997184:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360828.795915:0:8357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360828.796348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360828.796417:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130339968 00000100:00100000:3.0:1788360828.796424:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130339968 00010000:00010000:3.0:1788360828.796458:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610217 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0ee expref: 10 pid: 5792 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360828.796499:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:3.0:1788360828.796508:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2349:x1875232130339968:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360828.796522:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360828.796528:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610217 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0ee expref: 10 pid: 5792 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796551:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0ee expref: 10 pid: 5792 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796569:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586b400/0xf6a94c97d6610217 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0ee expref: 10 pid: 5792 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796585:0:7487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796592:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796623:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796630:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796636:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796641:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796647:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586a600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788360828.796650:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796658:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796680:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360828.796690:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360828.796740:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:2349:x1875232130339968:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 233us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360828.796748:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00010000:00010000:0.0:1788360828.796868:0:8357:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.796877:0:8357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.796883:0:8357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102b8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360828.904934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360828.905016:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130340096 00000100:00100000:0.0:1788360828.905026:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130340096 00000100:00100000:0.0:1788360828.905110:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:0.0:1788360828.905121:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:5562:x1875232130340096:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788360828.905138:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360828.905156:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e12d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.905182:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e12d expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.905194:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e12d expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360828.905216:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586a600, rc 0) 00000100:00100000:0.0:1788360828.905274:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5562:x1875232130340096:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 155us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.905281:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:3.0:1788360828.908447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360828.908518:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130340224 00000100:00100000:0.0:1788360828.908527:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130340224 00000100:00100000:0.0:1788360828.908589:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:0.0:1788360828.908599:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5562:x1875232130340224:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360828.908866:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5562:x1875232130340224:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 268us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.908874:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:0.0:1788360828.911863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360828.912017:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130340352 00000100:00100000:1.0:1788360828.912026:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130340352 00000100:00100000:1.0:1788360828.912136:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:1.0:1788360828.912145:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5562:x1875232130340352:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360828.912338:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:5562:x1875232130340352:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 193us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360828.912346:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:0.0:1788360828.924230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360828.924266:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130340480 00000100:00100000:0.0:1788360828.924275:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130340480 00000100:00100000:0.0:1788360828.924317:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:0.0:1788360828.924326:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:6066:x1875232130340480:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788360828.924526:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:6066:x1875232130340480:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 200us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.924547:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:0.0:1788360828.932220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360828.932254:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130340608 00000100:00100000:0.0:1788360828.932263:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130340608 00000100:00100000:0.0:1788360828.932309:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00100000:0.0:1788360828.932319:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:6066:x1875232130340608:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788360828.932556:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:6066:x1875232130340608:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 238us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360828.932564:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00100000:2.0:1788360829.577467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360829.577655:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130340736 00000100:00100000:3.0:1788360829.577666:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130340736 00000100:00100000:3.0:1788360829.577740:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788360829.577758:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130340736:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:1.0:1788360829.577800:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360829.578917:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130340736:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1156us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360829.578928:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788360829.583563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360829.583655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360829.583976:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130340864 00000100:00100000:0.0:1788360829.583986:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130340864 00000100:00100000:0.0:1788360829.584036:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130340992 00000100:00100000:0.0:1788360829.584039:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130340992 00000100:00100000:0.0:1788360829.584058:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788360829.584067:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130340864:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360829.584160:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130340864:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 94us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360829.584168:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788360829.584199:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788360829.584207:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130340992:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360829.584231:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130340992:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360829.584238:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:0.0:1788360829.584256:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788360829.584260:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788360829.664246:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788360829.792229:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788360829.792237:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a898534c800 from 4 10000000:01000000:0.0:1788360829.792242:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788360829.792289:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360829.792301:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360829.792328:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360829.792351:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788360829.792415:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360829.792471:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788360829.792605:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143998080 00000100:00100000:1.0:1788360829.792612:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143998080 00000100:00100000:1.0:1788360829.792653:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788360829.792661:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232143998080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788360829.792674:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360829.792687:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813cb400/0xf6a94c97d66102cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66102c6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.792709:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813cb400/0xf6a94c97d66102cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66102c6 expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.792719:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813cb400/0xf6a94c97d66102cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66102c6 expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.792727:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813cb400, rc 0) 00000100:00100000:1.0:1788360829.792775:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143998080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360829.792781:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788360829.792878:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360829.792898:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360829.792907:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360829.792957:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788360829.792984:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360829.793009:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88170cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360829.793125:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143998208 00000100:00100000:1.0:1788360829.793130:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143998208 00000100:00100000:1.0:1788360829.793161:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788360829.793169:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143998208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.793408:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143998208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360829.793415:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788360829.793447:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.793477:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.793514:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360829.793552:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788360829.793563:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143998336 00000100:00100000:1.0:1788360829.793567:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143998336 00000100:00100000:1.0:1788360829.793583:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788360829.793589:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143998336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.793716:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143998336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360829.793722:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788360829.793760:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.796027:0:8425:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8425:1875232143998464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360829.796188:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360829.796272:0:8425:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360829.796325:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143998464 00000100:00100000:2.0:1788360829.796333:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143998464 00000100:00100000:2.0:1788360829.796417:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788360829.796427:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:8425:x1875232143998464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788360829.796647:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:8425:x1875232143998464:12345-0@lo:502:llog_process_th.0 Request processed in 221us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360829.796655:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788360829.796737:0:8425:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8425:1875232143998464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788360829.796765:0:8425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788360829.796774:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360829.796776:0:8425:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788360829.796783:0:8425:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a898534c800 00000020:00000080:0.0:1788360829.796786:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788360829.796872:0:8425:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8425:1875232143998592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360829.796908:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360829.800608:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143998592 00000100:00100000:1.0:1788360829.800622:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143998592 00000100:00100000:1.0:1788360829.800671:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788360829.800680:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:8425:x1875232143998592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360829.800935:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:8425:x1875232143998592:12345-0@lo:502:llog_process_th.0 Request processed in 256us (4026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360829.800954:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788360829.804006:0:8425:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788360829.804118:0:8425:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8425:1875232143998592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788360829.804156:0:8425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360829.804164:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360829.804167:0:8425:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788360829.804171:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788360829.807903:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788360829.807939:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788360829.807950:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360829.807962:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360829.807973:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788360829.807975:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a86b49000 from 4 10000000:01000000:2.0:1788360829.807978:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788360829.808016:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360829.808033:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360829.808217:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360829.808245:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788360829.808310:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360829.808397:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a881706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360829.813334:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143998720 00000100:00100000:1.0:1788360829.813349:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143998720 00000100:00100000:1.0:1788360829.813419:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788360829.813441:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232143998720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788360829.813459:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360829.813477:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d66102db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66102d4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.813550:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d66102db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66102d4 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.813564:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d66102db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66102d4 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.813574:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a813cb000, rc 0) 00000100:00100000:1.0:1788360829.813660:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143998720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (5350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360829.813666:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788360829.813891:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360829.813912:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360829.813923:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360829.813986:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788360829.814024:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360829.814066:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a881706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360829.815324:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143998848 00000100:00100000:1.0:1788360829.815335:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143998848 00000100:00100000:1.0:1788360829.815376:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788360829.815384:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143998848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.815649:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143998848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360829.815657:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788360829.815704:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.815751:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.815802:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360829.815827:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788360829.815841:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143998976 00000100:00100000:1.0:1788360829.815844:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143998976 00000100:00100000:1.0:1788360829.815866:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788360829.815872:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143998976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.815998:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143998976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360829.816005:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788360829.816043:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143998976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788360829.816763:0:8428:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8428:1875232143999104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788360829.816818:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360829.816845:0:8428:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a881706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360829.816944:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143999104 00000100:00100000:1.0:1788360829.816949:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143999104 00000100:00100000:1.0:1788360829.816985:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788360829.816992:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8428:x1875232143999104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360829.817180:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8428:x1875232143999104:12345-0@lo:502:llog_process_th.0 Request processed in 188us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360829.817186:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788360829.817337:0:8428:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8428:1875232143999104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788360829.817362:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788360829.817370:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788360829.817378:0:8428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788360829.817387:0:8428:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a86b49000 00000020:00000080:2.0:1788360829.817389:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788360829.817465:0:8428:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8428:1875232143999232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788360829.817500:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360829.817518:0:8428:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a881706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360829.817918:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143999232 00000100:00100000:1.0:1788360829.817924:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143999232 00000100:00100000:1.0:1788360829.817957:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788360829.817964:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8428:x1875232143999232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788360829.820567:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:8428:x1875232143999232:12345-0@lo:502:llog_process_th.0 Request processed in 2595us (3059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360829.820580:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788360829.820697:0:8428:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8428:1875232143999232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788360829.820734:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788360829.820741:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788360829.820743:0:8428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788360829.820748:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788360829.820973:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788360829.820991:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788360829.821001:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.821020:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360829.821030:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788360829.821032:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a83778000 from 4 10000000:01000000:1.0:1788360829.821036:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788360829.821188:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.821197:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.821206:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360829.821227:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143999360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.821264:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360829.821335:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360829.823411:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143999360 00000100:00100000:3.0:1788360829.823433:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143999360 00000100:00100000:3.0:1788360829.823484:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788360829.823495:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232143999360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788360829.823510:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360829.823538:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d66102e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66102e2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360829.823566:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d66102e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66102e2 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360829.823578:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d66102e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66102e2 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360829.823587:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f600, rc 0) 00000100:00100000:3.0:1788360829.823900:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143999360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360829.823908:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788360829.824489:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143999360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788360829.824511:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.824531:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360829.824605:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143999488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.824659:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360829.824705:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360829.825344:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143999488 00000100:00100000:2.0:1788360829.825351:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143999488 00000100:00100000:2.0:1788360829.825400:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788360829.825411:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143999488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788360829.825687:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143999488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360829.825695:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788360829.825787:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143999488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.825834:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143999616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.825876:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360829.825905:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360829.825919:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143999616 00000100:00100000:1.0:1788360829.825922:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143999616 00000100:00100000:1.0:1788360829.825944:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788360829.825951:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143999616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360829.826294:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232143999616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 342us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360829.826301:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788360829.826378:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232143999616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788360829.826869:0:8430:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8430:1875232143999744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788360829.826908:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360829.826976:0:8430:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360829.827008:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143999744 00000100:00100000:1.0:1788360829.827012:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143999744 00000100:00100000:1.0:1788360829.827616:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788360829.827626:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a867e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:8430:x1875232143999744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360829.827799:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a867e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:8430:x1875232143999744:12345-0@lo:502:llog_process_th.0 Request processed in 166us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360829.827808:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788360829.827932:0:8430:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8430:1875232143999744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788360829.827957:0:8430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788360829.827965:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788360829.827967:0:8430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788360829.827976:0:8430:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a83778000 00000020:00000080:2.0:1788360829.827979:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788360829.828058:0:8430:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8430:1875232143999872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788360829.828114:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360829.828150:0:8430:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360829.828581:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232143999872 00000100:00100000:0.0:1788360829.828592:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232143999872 00000100:00100000:0.0:1788360829.828630:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788360829.828638:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a867e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:8430:x1875232143999872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788360829.828935:0:8430:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:8430:1875232143999872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788360829.828962:0:8430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788360829.828967:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788360829.828969:0:8430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788360829.828975:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:0.0:1788360829.829393:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a867e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:8430:x1875232143999872:12345-0@lo:502:llog_process_th.0 Request processed in 151us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360829.829403:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000020:01000000:1.0:1788360829.829516:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788360829.829545:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788360829.829555:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360829.829566:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360830.691307:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360831.712307:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360832.740885:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360833.185780:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144000000:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.185888:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360833.186608:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144000512:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.186676:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360833.186712:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788360833.186720:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144000128:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.186746:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360833.186765:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144000640:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.186792:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360833.186833:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144000512 00000100:00100000:3.0:1788360833.186844:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144000512 00000100:00100000:3.0:1788360833.186914:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144000128 00000100:00100000:3.0:1788360833.186917:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144000128 00000100:00100000:3.0:1788360833.186943:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788360833.186952:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144000512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.187014:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144000512:12345-0@lo:400:kworker.0 Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360833.187022:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788360833.187042:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788360833.187048:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144000128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.187076:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144000128:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360833.187082:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788360833.187129:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144000640 00000100:00100000:3.0:1788360833.187134:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144000640 00000100:00100000:3.0:1788360833.187164:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788360833.187170:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144000640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.187203:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144000640:12345-0@lo:400:kworker.0 Request processed in 33us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360833.187209:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788360833.187235:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788360833.187240:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360833.187284:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144000128:0@lo:400:kworker.0 00010000:00080000:3.0:1788360833.187300:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8986707b80 x1875232144000640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360833.187312:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144000640:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.187323:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144000512:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.187379:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144000256:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.187409:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360833.188743:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788360833.188764:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144000384:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.188848:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360833.188915:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144000384 00000100:00100000:3.0:1788360833.189026:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144000384 00000100:00100000:3.0:1788360833.189105:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788360833.189115:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144000384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.189171:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144000384:12345-0@lo:400:kworker.0 Request processed in 58us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360833.189178:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788360833.189200:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788360833.189803:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8986706a00 x1875232144000384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360833.189822:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144000384:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.189918:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144000256 00000100:00100000:3.0:1788360833.189925:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144000256 00000100:00100000:3.0:1788360833.189980:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788360833.189987:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144000256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.190047:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144000256:12345-0@lo:400:kworker.0 Request processed in 61us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360833.190055:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788360833.190077:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360833.190130:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144000256:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.190149:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144000768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360833.190182:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360833.190213:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144000768 00000100:00100000:3.0:1788360833.190217:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144000768 00000100:00100000:3.0:1788360833.190258:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788360833.190266:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144000768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788360833.190303:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788360833.190349:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144000768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360833.190355:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788360833.190388:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a835e0000 x1875232144000768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360833.190402:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144000000 00000100:00100000:3.0:1788360833.190407:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144000768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360833.190410:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144000000 00000100:00100000:0.0:1788360833.190463:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788360833.190472:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144000000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360833.190883:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144000000:12345-0@lo:400:kworker.0 Request processed in 412us (4995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360833.190891:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788360833.191496:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144000000:0@lo:400:kworker.0 00000100:00100000:3.0:1788360833.702297:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144000896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788360833.702462:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360833.702870:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144000896 00000100:00100000:3.0:1788360833.702892:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144000896 00000100:00100000:3.0:1788360833.702951:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788360833.702961:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144000896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788360833.703011:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788360833.703188:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144000896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 227us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360833.703196:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788360833.703251:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab71b0a80 x1875232144000896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360833.703274:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144000896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788360833.760401:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788360834.073977:0:8656:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788360834.698274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360834.698347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360834.698376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360834.698399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360834.698426:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130341376 00000100:00100000:0.0:1788360834.698426:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130341504 00000100:00100000:2.0:1788360834.698436:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130341376 00000100:00100000:0.0:1788360834.698436:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130341504 00000100:00100000:2.0:1788360834.698504:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788360834.698514:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130341376:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360834.698762:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130341376:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 248us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360834.698771:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788360834.700158:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130341248 00000100:00100000:1.0:1788360834.700169:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130341248 00000100:00100000:1.0:1788360834.700414:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1788360834.700425:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130341248:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360834.700487:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130341248:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360834.700505:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1788360834.700545:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130341120 00000100:00100000:1.0:1788360834.700550:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130341120 00000100:00100000:0.0:1788360834.700689:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1788360834.700697:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130341504:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360834.700727:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130341504:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 32us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360834.700734:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00080000:2.0:1788360834.701310:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788360834.701315:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788360834.701318:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788360834.702319:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:1.0:1788360834.702335:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2349:x1875232130341120:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360834.702408:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2349:x1875232130341120:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (4031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360834.702415:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 189 00010000:00010000:2.0:1788360834.784471:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360835.811450:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360836.833809:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360837.857438:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360838.304552:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144001280:0@lo:400:kworker.0 00000100:00100000:3.0:1788360838.304621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360838.304677:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788360838.304683:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898533a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144001408:0@lo:400:kworker.0 00000100:00100000:3.0:1788360838.304709:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360838.304757:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144001280 00000100:00100000:3.0:1788360838.304764:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144001280 00000100:00100000:3.0:1788360838.304815:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788360838.304824:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144001280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360838.304886:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144001280:12345-0@lo:400:kworker.0 Request processed in 51us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360838.304893:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788360838.304914:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144001408 00000100:00100000:3.0:1788360838.304917:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144001408 00000100:00100000:3.0:1788360838.304944:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788360838.304950:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144001408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360838.304990:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144001408:12345-0@lo:400:kworker.0 Request processed in 40us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360838.304997:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788360838.305013:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788360838.305018:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788360838.305070:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a898533a680 x1875232144001408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360838.305340:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898533a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144001408:0@lo:400:kworker.0 00000100:00100000:3.0:1788360838.305357:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144001280:0@lo:400:kworker.0 00000100:00100000:3.0:1788360838.305402:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788360838.305409:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144001792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360838.305436:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360838.305462:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144001792 00000100:00100000:3.0:1788360838.305477:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144001792 00000100:00100000:3.0:1788360838.305501:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788360838.305508:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144001792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788360838.305535:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788360838.305571:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144001792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360838.305576:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788360838.305602:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8985338e00 x1875232144001792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360838.305615:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144001792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788360838.305754:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144001152:0@lo:400:kworker.0 00000100:00100000:1.0:1788360838.305784:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360838.305809:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898533ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144001664:0@lo:400:kworker.0 00000100:00100000:1.0:1788360838.305830:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360838.305855:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788360838.305860:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144001024:0@lo:400:kworker.0 00000100:00100000:1.0:1788360838.305884:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360838.305906:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144001536:0@lo:400:kworker.0 00000100:00100000:1.0:1788360838.305930:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360838.305964:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144001664 00000100:00100000:1.0:1788360838.305968:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144001664 00000100:00100000:1.0:1788360838.305996:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788360838.306004:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144001664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360838.306058:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144001664:12345-0@lo:400:kworker.0 Request processed in 56us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360838.306064:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788360838.306112:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144001024 00000100:00100000:3.0:1788360838.306348:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144001152 00000100:00100000:3.0:1788360838.306353:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144001152 00000100:00100000:3.0:1788360838.306383:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144001536 00000100:00100000:3.0:1788360838.306386:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144001536 00000100:00100000:3.0:1788360838.306406:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788360838.306412:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144001152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360838.306444:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144001152:12345-0@lo:400:kworker.0 Request processed in 32us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360838.306450:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788360838.306462:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788360838.306477:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144001536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360838.306503:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144001536:12345-0@lo:400:kworker.0 Request processed in 36us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360838.306509:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788360838.306528:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788360838.306532:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788360838.306565:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144001024 00000100:00100000:1.0:1788360838.306603:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788360838.306610:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144001024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360838.306641:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144001024:12345-0@lo:400:kworker.0 Request processed in 32us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360838.306646:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788360838.306688:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144001024:0@lo:400:kworker.0 00000100:00100000:1.0:1788360838.306699:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144001536:0@lo:400:kworker.0 00000100:00100000:1.0:1788360838.306708:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144001152:0@lo:400:kworker.0 00010000:00080000:1.0:1788360838.306718:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a898533ad80 x1875232144001664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360838.306793:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898533ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144001664:0@lo:400:kworker.0 00000001:02000400:3.0:1788360838.723337:0:8901:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing yml_node 00000100:00100000:3.0:1788360838.818912:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144001920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788360838.818981:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360838.819258:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144001920 00000100:00100000:3.0:1788360838.819267:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144001920 00000100:00100000:3.0:1788360838.819328:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788360838.819337:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144001920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788360838.819372:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788360838.819413:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144001920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360838.819419:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788360838.819454:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a835e3800 x1875232144001920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360838.819499:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144001920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788360838.880735:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360839.817603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360839.817671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360839.817709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360839.817745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360839.817770:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130341760 00000100:00100000:0.0:1788360839.817779:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130342016 00000100:00100000:3.0:1788360839.817781:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130341760 00000100:00100000:0.0:1788360839.817785:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130342016 00000100:00100000:0.0:1788360839.817836:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130341888 00000100:00100000:0.0:1788360839.817839:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130341888 00000100:00100000:1.0:1788360839.817849:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130341632 00000100:00100000:1.0:1788360839.817853:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130341632 00000100:00100000:1.0:1788360839.817899:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 191 00000100:00100000:1.0:1788360839.817910:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2351:x1875232130341632:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360839.817983:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2351:x1875232130341632:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 75us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360839.818059:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 191 00000100:00100000:3.0:1788360839.818287:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:3.0:1788360839.818370:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2351:x1875232130341760:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360839.818409:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2351:x1875232130341760:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 115us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360839.818417:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:2.0:1788360839.819956:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788360839.819979:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2351:x1875232130342016:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360839.820053:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2351:x1875232130342016:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 84us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360839.820061:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788360839.825379:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788360839.825410:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2351:x1875232130341888:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360839.825526:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2351:x1875232130341888:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 134us (7780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360839.825533:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00080000:1.0:1788360839.825688:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788360839.827126:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788360839.827134:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788360839.905200:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360840.928735:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360841.954041:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788360842.667263:0:9092:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.2 00010000:00010000:3.0:1788360842.986176:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360843.424461:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898533aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144002048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360843.424535:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360843.424617:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360843.424624:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144002176:0@lo:400:kworker.0 00000100:00100000:0.0:1788360843.424653:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360843.424764:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144002048 00000100:00100000:1.0:1788360843.424774:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144002048 00000100:00100000:1.0:1788360843.424839:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788360843.424850:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144002048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788360843.424887:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360843.424936:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144002048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360843.424943:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788360843.425012:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788360843.425043:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a898533aa00 x1875232144002048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360843.425063:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898533aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144002048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788360843.425739:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788360843.428045:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144002176 00000100:00100000:3.0:1788360843.428060:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144002176 00000100:00100000:3.0:1788360843.428142:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788360843.428153:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144002176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360843.428245:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144002176:12345-0@lo:400:kworker.0 Request processed in 95us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360843.428252:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788360843.428290:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144002304:0@lo:400:kworker.0 00000100:00100000:3.0:1788360843.428340:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360843.428368:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788360843.428376:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144002432:0@lo:400:kworker.0 00000100:00100000:0.0:1788360843.428580:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144002176:0@lo:400:kworker.0 00000100:00100000:2.0:1788360843.428736:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788360843.428744:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144002688:0@lo:400:kworker.0 00000100:00100000:2.0:1788360843.428777:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360843.428806:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144002688 00000100:00100000:2.0:1788360843.428810:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144002688 00000100:00100000:2.0:1788360843.428851:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788360843.428858:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144002688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360843.428896:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144002688:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360843.428903:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788360843.428921:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788360843.428941:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab71b2300 x1875232144002688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360843.429844:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144002560:0@lo:400:kworker.0 00000100:00100000:1.0:1788360843.429890:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360843.429969:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144002304 00000100:00100000:0.0:1788360843.429975:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144002304 00000100:00100000:0.0:1788360843.430065:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144002560 00000100:00100000:0.0:1788360843.430081:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144002560 00000100:00100000:0.0:1788360843.430187:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788360843.430194:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144002304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360843.430238:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144002304:12345-0@lo:400:kworker.0 Request processed in 44us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360843.430245:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788360843.430258:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788360843.430263:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144002560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360843.430291:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144002560:12345-0@lo:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360843.430296:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788360843.430509:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144002560:0@lo:400:kworker.0 00000100:00100000:2.0:1788360843.431285:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144002688:0@lo:400:kworker.0 00000100:00080000:2.0:1788360843.431315:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360843.431992:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360843.432035:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144002304:0@lo:400:kworker.0 00000100:00100000:0.0:1788360843.434568:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144002432 00000100:00100000:0.0:1788360843.434658:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144002432 00000100:00100000:0.0:1788360843.434901:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788360843.434912:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144002432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360843.435021:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144002432:12345-0@lo:400:kworker.0 Request processed in 111us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360843.435029:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788360843.436036:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144002432:0@lo:400:kworker.0 00000100:00080000:2.0:1788360843.438974:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360843.936641:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144002816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788360843.936716:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360843.936839:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144002816 00000100:00100000:1.0:1788360843.936848:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144002816 00000100:00100000:1.0:1788360843.936900:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788360843.936909:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144002816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788360843.936944:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360843.936995:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144002816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360843.937013:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788360843.937154:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a835e1500 x1875232144002816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360843.937186:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144002816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788360844.001128:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360844.942767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360844.942818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360844.942977:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130342144 00000100:00100000:2.0:1788360844.942988:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130342144 00000100:00100000:2.0:1788360844.943049:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:2.0:1788360844.943059:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2352:x1875232130342144:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360844.943160:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2352:x1875232130342144:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 102us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360844.943168:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:3.0:1788360844.943354:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130342272 00000100:00100000:3.0:1788360844.943359:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130342272 00000100:00100000:3.0:1788360844.943406:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:3.0:1788360844.943413:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2352:x1875232130342272:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360844.943461:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2352:x1875232130342272:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 48us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360844.943468:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00080000:2.0:1788360844.943661:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360844.970991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360844.971135:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130342400 00000100:00100000:3.0:1788360844.971145:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130342400 00000100:00100000:3.0:1788360844.971227:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788360844.971239:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2348:x1875232130342400:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:3.0:1788360844.971275:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6610225 00000100:00080000:3.0:1788360844.971284:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9a8abccc5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788360844.971319:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1788360844.972248:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788360844.972636:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360844.974657:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+2:2348:x1875232130342400:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 1697us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360844.974692:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788360844.979015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360844.980663:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130342528 00000100:00100000:2.0:1788360844.980681:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130342528 00000100:00100000:2.0:1788360844.980763:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788360844.980773:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2348:x1875232130342528:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:2.0:1788360844.980816:0:6592:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661022c 00000100:00080000:2.0:1788360844.980826:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a587000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788360844.980863:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788360844.981255:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+2:2348:x1875232130342528:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 482us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360844.981264:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00010000:00010000:2.0:1788360844.981286:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788360844.981940:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788360845.027868:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788360845.124683:0:9190:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.2 00000001:00100000:3.0:1788360846.046064:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:3.0:1788360846.046072:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8abccc1800/11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:3.0:1788360846.046122:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abccc1800/11e5d128-044a-45c3-b501-2dba6e5a82fa for lustre-OST0000 00000020:00000080:3.0:1788360846.046158:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8abccc5000 for lustre-OST0000 00010000:00010000:1.0:1788360846.053268:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788360847.054998:0:9288:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.2 00010000:00010000:2.0:1788360847.073380:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360848.099192:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788360848.464645:0:9336:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 2 10:54:07 EDT 2026 00000100:00100000:2.0:1788360848.544834:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144003072:0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.544907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360848.544957:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144003584:0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.544995:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360848.545026:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788360848.545031:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144003200:0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.545051:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360848.545082:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144003072 00000100:00100000:2.0:1788360848.545106:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144003072 00000100:00100000:2.0:1788360848.545147:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144003200 00000100:00100000:2.0:1788360848.545150:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144003200 00000100:00100000:2.0:1788360848.545180:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788360848.545189:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144003072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.545242:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144003072:12345-0@lo:400:kworker.0 Request processed in 54us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360848.545250:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788360848.545292:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788360848.545300:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144003200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.545329:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144003200:12345-0@lo:400:kworker.0 Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360848.545334:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788360848.545353:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144003584 00000100:00100000:2.0:1788360848.545357:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144003584 00000100:00100000:2.0:1788360848.545382:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788360848.545388:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144003584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.545429:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144003584:12345-0@lo:400:kworker.0 Request processed in 41us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360848.545434:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788360848.545479:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144003200:0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.545491:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144003072:0@lo:400:kworker.0 00010000:00080000:2.0:1788360848.545502:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a83543100 x1875232144003584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360848.545512:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144003584:0@lo:400:kworker.0 00000100:00100000:3.0:1788360848.545606:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232144002944:0@lo:400:kworker.0 00000100:00100000:3.0:1788360848.545649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360848.545680:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144003456:0@lo:400:kworker.0 00000100:00100000:3.0:1788360848.545702:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360848.545718:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788360848.545724:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144003328:0@lo:400:kworker.0 00000100:00100000:3.0:1788360848.545746:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360848.545770:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144003328 00000100:00100000:3.0:1788360848.545774:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144003328 00000100:00100000:3.0:1788360848.545798:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788360848.545805:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144003328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360848.545839:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144003328:12345-0@lo:400:kworker.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360848.545845:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788360848.545870:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab71b1500 x1875232144003328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360848.545880:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144003328:0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.546009:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144002944 00000100:00100000:2.0:1788360848.546014:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144002944 00000100:00100000:2.0:1788360848.546049:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788360848.546056:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232144002944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.546120:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232144002944:12345-0@lo:400:kworker.0 Request processed in 65us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360848.546126:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788360848.546171:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232144002944:0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.546194:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144003456 00000100:00100000:2.0:1788360848.546198:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144003456 00000100:00100000:2.0:1788360848.546230:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788360848.546236:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144003456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360848.546274:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144003456:12345-0@lo:400:kworker.0 Request processed in 37us (570us total) trans 0 rc 0/0 00000100:00080000:0.0:1788360848.546336:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788360848.546341:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788360848.546344:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360848.546540:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360848.546553:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144003712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360848.546594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360848.546635:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144003712 00000100:00100000:0.0:1788360848.546639:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144003712 00000100:00100000:2.0:1788360848.546660:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788360848.546682:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788360848.546693:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144003712:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360848.546710:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144003456:0@lo:400:kworker.0 00002000:00000024:0.0:1788360848.546722:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360848.546769:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144003712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360848.546775:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788360848.546911:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab7799180 x1875232144003712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360848.546927:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144003712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360849.057317:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788360849.057340:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144003840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788360849.057544:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360849.057637:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144003840 00000100:00100000:0.0:1788360849.057645:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144003840 00000100:00100000:0.0:1788360849.057694:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788360849.057704:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144003840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788360849.057737:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360849.057783:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144003840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360849.057790:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788360849.057905:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab779b480 x1875232144003840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360849.057923:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144003840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788360849.122912:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788360849.630420:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:1.0:1788360849.630429:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a8a581000/11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:2.0:1788360849.630729:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a581000/11e5d128-044a-45c3-b501-2dba6e5a82fa for lustre-OST0001 00000020:00000080:2.0:1788360849.630781:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a587000 for lustre-OST0001 00000100:00100000:3.0:1788360850.058414:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360850.058464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360850.058465:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130342656 00000100:00100000:0.0:1788360850.058477:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130342656 00000100:00100000:0.0:1788360850.058540:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:0.0:1788360850.058557:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2352:x1875232130342656:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360850.058635:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2352:x1875232130342656:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360850.058644:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:1.0:1788360850.058845:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130342784 00000100:00100000:1.0:1788360850.058851:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130342784 00000100:00100000:1.0:1788360850.058907:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:1.0:1788360850.058918:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2352:x1875232130342784:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360850.058959:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2352:x1875232130342784:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 44us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360850.058966:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00080000:0.0:1788360850.059495:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788360850.148831:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360851.168350:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360852.199920:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360853.216455:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360853.664323:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144004096:0@lo:400:kworker.0 00000100:00100000:2.0:1788360853.664395:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360853.664435:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144004608:0@lo:400:kworker.0 00000100:00100000:1.0:1788360853.664453:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144004352:0@lo:400:kworker.0 00000100:00100000:2.0:1788360853.664460:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360853.664494:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788360853.664500:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360853.664504:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144004224:0@lo:400:kworker.0 00000100:00100000:1.0:1788360853.664527:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788360853.664535:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360853.664538:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144003968:0@lo:400:kworker.0 00000100:00100000:2.0:1788360853.664571:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144004096 00000100:00100000:1.0:1788360853.664575:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360853.664579:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144004096 00000100:00100000:1.0:1788360853.664601:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144004480:0@lo:400:kworker.0 00000100:00100000:2.0:1788360853.664621:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144004224 00000100:00100000:1.0:1788360853.664626:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360853.664803:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788360853.664812:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144004736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788360853.664836:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360853.664938:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144004736 00000100:00100000:0.0:1788360853.664943:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144004736 00000100:00100000:0.0:1788360853.664994:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788360853.665003:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144004736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788360853.665037:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360853.665105:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144004736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360853.665113:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788360853.665149:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab779b800 x1875232144004736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360853.665168:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144004736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360853.665244:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144004608 00000100:00100000:3.0:1788360853.665256:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144004608 00000100:00100000:3.0:1788360853.665297:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144004352 00000100:00100000:3.0:1788360853.665301:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144004352 00000100:00100000:3.0:1788360853.665313:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788360853.665319:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144004608:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788360853.665538:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788360853.665542:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788360853.665691:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144004224 00000100:00100000:2.0:1788360853.665719:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144004480 00000100:00100000:2.0:1788360853.665721:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144004480 00000100:00100000:2.0:1788360853.665737:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788360853.665755:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144004096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360853.665808:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144004096:12345-0@lo:400:kworker.0 Request processed in 59us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360853.665815:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788360853.665829:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788360853.665835:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144004224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360853.665863:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144004224:12345-0@lo:400:kworker.0 Request processed in 28us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360853.665868:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788360853.665878:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788360853.665884:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144004480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360853.665922:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144004224:0@lo:400:kworker.0 00000100:00100000:0.0:1788360853.665989:0:6593:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788360853.665998:0:6593:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788360853.666067:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144004480:12345-0@lo:400:kworker.0 Request processed in 182us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360853.666075:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788360853.666115:0:6592:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788360853.666120:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144004480:0@lo:400:kworker.0 00000100:00100000:2.0:1788360853.666127:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788360853.666154:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144004352:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788360853.666232:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a83540a80 x1875232144004352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360853.666242:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144004352:0@lo:400:kworker.0 00000100:00100000:2.0:1788360853.666255:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144004352:12345-0@lo:400:kworker.0 Request processed in 118us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360853.666262:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788360853.666375:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788360853.666711:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144004096:0@lo:400:kworker.0 00000100:00100000:3.0:1788360853.666963:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144004608:12345-0@lo:400:kworker.0 Request processed in 1642us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360853.666971:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788360853.666993:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144003968 00000100:00100000:3.0:1788360853.666998:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144003968 00000100:00100000:3.0:1788360853.667061:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788360853.667068:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144003968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360853.667131:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144003968:12345-0@lo:400:kworker.0 Request processed in 63us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360853.667137:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00080000:1.0:1788360853.667195:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab71b2300 x1875232144004608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360853.667206:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144004608:0@lo:400:kworker.0 00000100:00100000:3.0:1788360853.667372:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144003968:0@lo:400:kworker.0 00000100:00100000:1.0:1788360854.176736:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144004864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788360854.176882:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360854.176963:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144004864 00000100:00100000:0.0:1788360854.176973:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144004864 00000100:00100000:0.0:1788360854.177045:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788360854.177056:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144004864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788360854.177132:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360854.177195:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144004864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360854.177202:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788360854.177442:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab779b800 x1875232144004864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360854.177463:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144004864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788360854.240214:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360855.176337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360855.176393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360855.176422:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130342912 00000100:00100000:1.0:1788360855.176431:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130342912 00000100:00100000:1.0:1788360855.176478:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:1.0:1788360855.176488:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2351:x1875232130342912:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360855.176600:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2351:x1875232130342912:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 113us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360855.176608:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:3.0:1788360855.178651:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130343040 00000100:00100000:3.0:1788360855.178665:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130343040 00000100:00100000:3.0:1788360855.178806:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1788360855.178816:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2351:x1875232130343040:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360855.178886:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2351:x1875232130343040:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 72us (2559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360855.178892:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00080000:1.0:1788360855.179160:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788360855.267593:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360856.288272:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360857.313149:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360858.337193:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360858.785275:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232144004992:0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.785377:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360858.785422:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144005504:0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.785448:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360858.785472:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788360858.785478:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144005376:0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.785502:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360858.785535:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144004992 00000100:00100000:1.0:1788360858.785542:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144004992 00000100:00100000:1.0:1788360858.785586:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788360858.785601:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232144004992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.785649:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232144004992:12345-0@lo:400:kworker.0 Request processed in 55us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360858.785655:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788360858.785705:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232144004992:0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.785739:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144005120:0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.785762:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360858.785780:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144005632:0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.785847:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360858.785866:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788360858.785871:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144005248:0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.785890:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360858.785912:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144005504 00000100:00100000:1.0:1788360858.785915:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144005504 00000100:00100000:1.0:1788360858.785945:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144005120 00000100:00100000:1.0:1788360858.785948:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144005120 00000100:00100000:1.0:1788360858.785958:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144005248 00000100:00100000:1.0:1788360858.785966:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144005248 00000100:00100000:1.0:1788360858.785982:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788360858.785989:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144005504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.786025:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144005504:12345-0@lo:400:kworker.0 Request processed in 36us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360858.786031:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788360858.786044:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788360858.786050:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144005120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.786081:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144005120:12345-0@lo:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360858.786135:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788360858.786148:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788360858.786154:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144005248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.786180:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144005248:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360858.786185:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788360858.786201:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144005376 00000100:00100000:1.0:1788360858.786204:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144005376 00000100:00100000:1.0:1788360858.786228:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144005632 00000100:00100000:1.0:1788360858.786231:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144005632 00000100:00100000:1.0:1788360858.786253:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788360858.786260:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144005376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.786290:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144005376:12345-0@lo:400:kworker.0 Request processed in 31us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360858.786296:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788360858.786307:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788360858.786312:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144005632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.786360:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144005632:12345-0@lo:400:kworker.0 Request processed in 47us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360858.786366:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788360858.786386:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788360858.786390:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788360858.786392:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788360858.786418:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144005248:0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.786427:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144005120:0@lo:400:kworker.0 00010000:00080000:1.0:1788360858.786438:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a83543100 x1875232144005632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360858.786448:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144005632:0@lo:400:kworker.0 00010000:00080000:1.0:1788360858.786474:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab7799180 x1875232144005376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360858.786483:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144005376:0@lo:400:kworker.0 00000100:00100000:1.0:1788360858.786491:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144005504:0@lo:400:kworker.0 00000100:00100000:3.0:1788360858.787531:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898533ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144005760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360858.787580:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360858.790375:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144005760 00000100:00100000:2.0:1788360858.790390:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144005760 00000100:00100000:2.0:1788360858.790447:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788360858.790457:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144005760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788360858.790523:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788360858.791232:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144005760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 775us (3650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360858.791241:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788360858.791434:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a898533ad80 x1875232144005760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360858.791467:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898533ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144005760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360859.296450:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788360859.296474:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144005888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788360859.296537:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360859.296652:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144005888 00000100:00100000:0.0:1788360859.296660:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144005888 00000100:00100000:0.0:1788360859.296712:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788360859.296722:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144005888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788360859.296756:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360859.296802:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144005888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360859.296809:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788360859.296847:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a83540a80 x1875232144005888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360859.296864:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144005888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788360859.360423:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788360860.017758:0:9971:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:54:19 (1788360859) === 00000100:00100000:1.0:1788360860.308047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360860.308192:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360860.309497:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130343296 00000100:00100000:3.0:1788360860.309509:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130343296 00000100:00100000:3.0:1788360860.309609:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:3.0:1788360860.309619:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130343296:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360860.309705:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130343296:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 87us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360860.309712:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1788360860.310104:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130343168 00000100:00100000:0.0:1788360860.310109:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130343168 00000100:00100000:0.0:1788360860.310147:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:0.0:1788360860.310154:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:8086:x1875232130343168:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788360860.310165:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360860.310182:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586b400/0xf6a94c97d66102f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e134 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360860.310206:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586b400/0xf6a94c97d66102f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e134 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360860.310230:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586b400/0xf6a94c97d66102f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e134 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360860.310240:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586b400, rc 0) 00000100:00100000:0.0:1788360860.310280:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:8086:x1875232130343168:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 126us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360860.310287:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00080000:1.0:1788360860.311360:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788360860.313306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360860.313490:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130343424 00000100:00100000:2.0:1788360860.313500:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130343424 00000100:00100000:2.0:1788360860.313563:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:2.0:1788360860.313571:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:8086:x1875232130343424:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788360860.314426:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:8086:x1875232130343424:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 851us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360860.314437:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:2.0:1788360860.316846:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360860.317240:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130343552 00000100:00100000:0.0:1788360860.317251:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130343552 00000100:00100000:0.0:1788360860.317306:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:0.0:1788360860.317324:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:8086:x1875232130343552:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788360860.317799:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:8086:x1875232130343552:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 483us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360860.317808:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:3.0:1788360860.320564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360860.321053:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130343680 00000100:00100000:2.0:1788360860.321063:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130343680 00000100:00100000:2.0:1788360860.321205:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 202 00000100:00100000:2.0:1788360860.321216:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:8090:x1875232130343680:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788360860.322421:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:8090:x1875232130343680:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 1201us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360860.322433:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 202 00000100:00100000:1.0:1788360860.342285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360860.342402:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130343808 00000100:00100000:0.0:1788360860.342414:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130343808 00000100:00100000:0.0:1788360860.342472:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:0.0:1788360860.342483:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:8090:x1875232130343808:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788360860.342811:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:8090:x1875232130343808:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 329us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360860.342819:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:3.0:1788360860.349822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360860.350287:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130343936 00000100:00100000:2.0:1788360860.350310:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130343936 00000100:00100000:2.0:1788360860.350378:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:2.0:1788360860.350388:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:8086:x1875232130343936:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788360860.350406:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360860.350423:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66102f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e15e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360860.350451:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66102f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e15e expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360860.350463:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66102f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e15e expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360860.350472:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e000, rc 0) 00000100:00100000:2.0:1788360860.350544:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:8086:x1875232130343936:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 158us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360860.350552:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:1.0:1788360860.353963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360860.354226:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130344064 00000100:00100000:3.0:1788360860.354237:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130344064 00000100:00100000:3.0:1788360860.354297:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:3.0:1788360860.354306:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:8086:x1875232130344064:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788360860.354345:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788360860.354368:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788360860.354372:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788360860.354375:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788360860.354377:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788360860.357260:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:8086:x1875232130344064:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 2945us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360860.357284:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:0.0:1788360860.359940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360860.360062:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130344192 00000100:00100000:1.0:1788360860.360073:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130344192 00000100:00100000:1.0:1788360860.360252:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 206 00000100:00100000:1.0:1788360860.360260:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:8086:x1875232130344192:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788360860.360303:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360860.360332:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d66102fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e165 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360860.360362:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d66102fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e165 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360860.360374:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d66102fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e165 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360860.360389:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b600, rc 0) 00000100:00100000:1.0:1788360860.360455:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:8086:x1875232130344192:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 194us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360860.360462:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 206 00000100:00100000:1.0:1788360860.362278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360860.362434:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130344320 00000100:00100000:2.0:1788360860.362444:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130344320 00000100:00100000:2.0:1788360860.362492:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:2.0:1788360860.362501:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:8086:x1875232130344320:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788360860.362846:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:8086:x1875232130344320:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 345us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360860.362855:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:2.0:1788360860.366152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360860.366290:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130344448 00000100:00100000:1.0:1788360860.366301:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130344448 00000100:00100000:1.0:1788360860.366363:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:1.0:1788360860.366372:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:8086:x1875232130344448:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788360860.366591:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:8086:x1875232130344448:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 212us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360860.366599:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:0.0:1788360860.370994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360860.372460:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130344576 00000100:00100000:2.0:1788360860.372472:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130344576 00000100:00100000:2.0:1788360860.372577:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:2.0:1788360860.372594:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:8094:x1875232130344576:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788360860.372820:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:8094:x1875232130344576:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 227us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360860.372828:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:3.0:1788360860.374817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360860.375028:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130344704 00000100:00100000:0.0:1788360860.375045:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130344704 00000100:00100000:0.0:1788360860.375111:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 210 00000100:00100000:0.0:1788360860.375119:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:8094:x1875232130344704:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788360860.375334:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:8094:x1875232130344704:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 216us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360860.375342:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 210 00000100:00100000:3.0:1788360860.379452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360860.379505:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130344832 00000100:00100000:1.0:1788360860.379515:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130344832 00000100:00100000:1.0:1788360860.379563:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788360860.379572:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2348:x1875232130344832:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788360860.379603:0:6736:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 67937cdd-2aa9-412f-a448-3db0f2b2b807@192.168.203.60@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:1.0:1788360860.379657:0:6736:0:(genops.c:1406:class_connect()) connect: client 67937cdd-2aa9-412f-a448-3db0f2b2b807, cookie 0xf6a94c97d6610305 00000004:00100000:1.0:1788360860.379691:0:6736:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788360860.380056:0:6736:0:(import.c:65:import_set_state_nolock()) ffff9a8ab76db800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788360860.380502:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2348:x1875232130344832:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 928us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360860.380511:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00010000:00010000:1.0:1788360860.384297:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360860.384659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360860.384718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360860.384764:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130344960 00000100:00100000:1.0:1788360860.384775:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130344960 00000100:00100000:1.0:1788360860.384848:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130345088 00000100:00100000:1.0:1788360860.384851:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130345088 00000100:00100000:1.0:1788360860.384877:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788360860.384886:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+7:0:x1875232130344960:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788360860.384929:0:5799:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1788360860.385006:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360860.385041:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788360860.385054:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+7:8086:x1875232130345088:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788360860.385071:0:5797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788360860.385073:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+7:0:x1875232130344960:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 184us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360860.385102:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788360860.385146:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:8086:x1875232130345088:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 95us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360860.385153:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788360860.389485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360860.389660:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130345216 00000100:00100000:1.0:1788360860.389669:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130345216 00000100:00100000:1.0:1788360860.389728:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788360860.389739:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:8086:x1875232130345216:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788360860.389857:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:8086:x1875232130345216:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 120us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360860.389865:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788360860.396529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360860.396572:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360860.396605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360860.396691:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130345344 00000100:00100000:2.0:1788360860.396702:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130345344 00000100:00100000:2.0:1788360860.396743:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130345472 00000100:00100000:2.0:1788360860.396746:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130345472 00000100:00100000:2.0:1788360860.396765:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788360860.396773:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875232130345344:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788360860.396814:0:6594:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 67937cdd-2aa9-412f-a448-3db0f2b2b807@192.168.203.60@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1788360860.396847:0:6594:0:(genops.c:1406:class_connect()) connect: client 67937cdd-2aa9-412f-a448-3db0f2b2b807, cookie 0xf6a94c97d661030c 00002000:00100000:2.0:1788360860.396858:0:6594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 67937cdd-2aa9-412f-a448-3db0f2b2b807/ffff9a8ac0a1d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788360860.396881:0:6594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788360860.397158:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788360860.397165:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875232130345472:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788360860.397197:0:6593:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 67937cdd-2aa9-412f-a448-3db0f2b2b807@192.168.203.60@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:1.0:1788360860.397223:0:6593:0:(genops.c:1406:class_connect()) connect: client 67937cdd-2aa9-412f-a448-3db0f2b2b807, cookie 0xf6a94c97d6610313 00002000:00100000:1.0:1788360860.397230:0:6593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 67937cdd-2aa9-412f-a448-3db0f2b2b807/ffff9a8ab76db000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788360860.397237:0:6593:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788360860.397366:0:6594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788360860.397399:0:6594:0:(import.c:65:import_set_state_nolock()) ffff9a8ac0a1a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788360860.397470:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130345600 00000100:00100000:2.0:1788360860.397473:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2348:x1875232130345344:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 698us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360860.397476:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130345600 00000100:00100000:2.0:1788360860.397495:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788360860.397519:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1788360860.397529:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:8086:x1875232130345600:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788360860.397745:0:5800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788360860.397900:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:8086:x1875232130345600:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 373us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360860.397907:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00002000:00080000:0.0:1788360860.400571:0:6593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788360860.400613:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788360860.400693:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2348:x1875232130345472:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 3525us (4085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360860.400703:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000001:00100000:1.0:1788360861.385887:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 67937cdd-2aa9-412f-a448-3db0f2b2b807 00010000:00010000:1.0:1788360861.410172:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360862.435471:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360863.456284:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360863.904476:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788360863.904501:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144006016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788360863.904585:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360863.904686:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144006016 00000100:00100000:0.0:1788360863.904695:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144006016 00000100:00100000:0.0:1788360863.904765:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788360863.904774:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144006016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788360863.904809:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360863.904857:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144006016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360863.904881:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788360863.904921:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a84855880 x1875232144006016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360863.904939:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144006016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788360863.905028:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788360863.905224:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144006272:0@lo:400:kworker.0 00000100:00100000:3.0:1788360863.905258:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360863.905288:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788360863.905304:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144006144:0@lo:400:kworker.0 00000100:00100000:3.0:1788360863.905333:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360863.905351:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144006656:0@lo:400:kworker.0 00000100:00100000:3.0:1788360863.905374:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360863.905439:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144006272 00000100:00100000:2.0:1788360863.905445:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144006272 00000100:00100000:2.0:1788360863.905483:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788360863.905490:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144006272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360863.905532:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144006272:12345-0@lo:400:kworker.0 Request processed in 42us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360863.905538:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788360863.905554:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144006656 00000100:00100000:2.0:1788360863.905557:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144006656 00000100:00100000:2.0:1788360863.905586:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788360863.905592:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144006656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360863.905621:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144006656:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360863.905627:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788360863.905643:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788360863.905661:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab6da7100 x1875232144006656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360863.905670:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144006656:0@lo:400:kworker.0 00000100:00100000:2.0:1788360863.905679:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144006272:0@lo:400:kworker.0 00000100:00100000:0.0:1788360863.905840:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144006528:0@lo:400:kworker.0 00000100:00100000:0.0:1788360863.905869:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360863.905894:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788360863.905900:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144006400:0@lo:400:kworker.0 00000100:00100000:0.0:1788360863.905920:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360863.905952:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144006144 00000100:00100000:0.0:1788360863.905956:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144006144 00000100:00100000:0.0:1788360863.905979:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788360863.905985:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144006144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360863.906026:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144006144:12345-0@lo:400:kworker.0 Request processed in 41us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360863.906032:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788360863.906105:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144006528 00000100:00100000:3.0:1788360863.906109:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144006528 00000100:00100000:3.0:1788360863.906141:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144006400 00000100:00100000:3.0:1788360863.906144:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144006400 00000100:00100000:3.0:1788360863.906164:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788360863.906170:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144006528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360863.906202:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144006528:12345-0@lo:400:kworker.0 Request processed in 32us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360863.906208:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788360863.906218:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788360863.906222:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144006400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360863.906244:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144006400:12345-0@lo:400:kworker.0 Request processed in 21us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360863.906259:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788360863.906348:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360863.906369:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144006400:0@lo:400:kworker.0 00000100:00100000:0.0:1788360863.906378:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144006528:0@lo:400:kworker.0 00000100:00100000:2.0:1788360863.906590:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144006144:0@lo:400:kworker.0 00000100:00100000:2.0:1788360864.416348:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144006784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788360864.416420:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360864.416899:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144006784 00000100:00100000:0.0:1788360864.416909:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144006784 00000100:00100000:0.0:1788360864.416967:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788360864.416979:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144006784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788360864.417016:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360864.417105:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144006784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360864.417113:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788360864.417152:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab6da7b80 x1875232144006784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360864.417170:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144006784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788360864.480164:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788360864.481263:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 67937cdd-2aa9-412f-a448-3db0f2b2b807 00000001:02000400:0.0:1788360864.717922:0:10166:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:2.0:1788360865.004851:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 67937cdd-2aa9-412f-a448-3db0f2b2b807 00000100:00100000:3.0:1788360865.419874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360865.419912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360865.419937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360865.419956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360865.419988:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360865.420023:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130345984 00000100:00100000:3.0:1788360865.420032:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130345984 00000100:00100000:3.0:1788360865.420123:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130345856 00000100:00100000:3.0:1788360865.420127:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130345856 00000100:00100000:3.0:1788360865.420154:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:3.0:1788360865.420164:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130345984:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360865.420235:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130345984:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 72us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360865.420243:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:3.0:1788360865.420259:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:3.0:1788360865.420265:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130345856:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360865.420307:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130345856:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 42us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360865.420314:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:3.0:1788360865.420333:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130346240 00000100:00100000:3.0:1788360865.420337:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130346240 00000100:00100000:3.0:1788360865.420362:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130346112 00000100:00100000:3.0:1788360865.420365:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130346112 00000100:00100000:3.0:1788360865.420385:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:3.0:1788360865.420392:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130346240:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360865.420440:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130346240:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 48us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360865.420447:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:3.0:1788360865.420459:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788360865.420465:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130346112:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360865.420491:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130346112:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360865.420497:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00080000:3.0:1788360865.420520:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788360865.420524:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788360865.420527:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360865.421006:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130345728 00000100:00100000:0.0:1788360865.421012:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130345728 00000100:00100000:0.0:1788360865.421059:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 212 00000100:00100000:0.0:1788360865.421067:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2350:x1875232130345728:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360865.421130:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2350:x1875232130345728:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 64us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360865.421138:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 212 00010000:00010000:1.0:1788360865.504187:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360866.529216:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360867.552324:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360868.578850:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360869.026375:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144006912:0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.026443:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360869.026497:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144007424:0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.026529:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360869.026556:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788360869.026562:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144007040:0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.026585:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360869.026602:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144007552:0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.026622:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360869.026658:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144007168:0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.026679:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360869.026693:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144007680:0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.026709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360869.026724:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360869.026728:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144007296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360869.026747:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360869.026887:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144007424 00000100:00100000:0.0:1788360869.026895:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144007424 00000100:00100000:0.0:1788360869.026941:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144007680 00000100:00100000:0.0:1788360869.026944:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144007680 00000100:00100000:0.0:1788360869.026965:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788360869.026973:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144007424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.027022:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144007424:12345-0@lo:400:kworker.0 Request processed in 49us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360869.027029:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788360869.027044:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788360869.027049:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144007680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.027080:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144007680:12345-0@lo:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360869.027102:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788360869.027120:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144007040 00000100:00100000:0.0:1788360869.027123:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144007040 00000100:00100000:0.0:1788360869.027145:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144007552 00000100:00100000:0.0:1788360869.027149:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144007552 00000100:00100000:0.0:1788360869.027160:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144007168 00000100:00100000:0.0:1788360869.027162:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144007168 00000100:00100000:0.0:1788360869.027177:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788360869.027189:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144007040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.027232:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144007040:12345-0@lo:400:kworker.0 Request processed in 43us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360869.027238:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788360869.027250:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788360869.027266:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144007552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.027299:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144007552:12345-0@lo:400:kworker.0 Request processed in 42us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360869.027304:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788360869.027315:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788360869.027321:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144007168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.027345:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144007168:12345-0@lo:400:kworker.0 Request processed in 24us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360869.027350:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788360869.027377:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144007296 00000100:00100000:0.0:1788360869.027381:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144007296 00000100:00100000:0.0:1788360869.027404:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788360869.027409:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144007296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788360869.027435:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360869.027467:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144007296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360869.027473:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788360869.027488:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788360869.027492:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788360869.027494:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788360869.027684:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144006912 00000100:00100000:1.0:1788360869.027689:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144006912 00000100:00100000:1.0:1788360869.027719:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788360869.027726:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144006912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360869.027760:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144006912:12345-0@lo:400:kworker.0 Request processed in 35us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360869.027767:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00010000:00080000:0.0:1788360869.027907:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a84857b80 x1875232144007296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360869.027933:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144007296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360869.027948:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144007168:0@lo:400:kworker.0 00010000:00080000:0.0:1788360869.027958:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc894700 x1875232144007680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360869.027966:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144007680:0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.028001:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144007040:0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.028011:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144007552:0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.028019:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144006912:0@lo:400:kworker.0 00010000:00080000:0.0:1788360869.028028:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc897b80 x1875232144007424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360869.028036:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144007424:0@lo:400:kworker.0 00000100:00100000:0.0:1788360869.536735:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144007808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788360869.536811:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360869.537385:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144007808 00000100:00100000:1.0:1788360869.537394:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144007808 00000100:00100000:1.0:1788360869.537450:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788360869.537460:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144007808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788360869.537512:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360869.537575:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144007808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360869.537584:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788360869.537621:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab6da7100 x1875232144007808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360869.537640:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144007808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788360869.605924:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360870.539510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360870.539553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360870.539587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360870.539608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360870.539638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360870.539673:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130346496 00000100:00100000:1.0:1788360870.539685:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130346496 00000100:00100000:1.0:1788360870.539753:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130346624 00000100:00100000:1.0:1788360870.539756:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130346624 00000100:00100000:1.0:1788360870.539782:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:1.0:1788360870.539793:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2351:x1875232130346496:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360870.539894:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2351:x1875232130346496:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 102us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360870.539902:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:1.0:1788360870.539921:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:1.0:1788360870.539928:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2351:x1875232130346624:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360870.539975:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2351:x1875232130346624:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 47us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360870.539981:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:1.0:1788360870.540001:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130346752 00000100:00100000:1.0:1788360870.540005:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130346752 00000100:00100000:1.0:1788360870.540032:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130346880 00000100:00100000:1.0:1788360870.540041:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130346880 00000100:00100000:1.0:1788360870.540065:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788360870.540070:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2351:x1875232130346752:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360870.540119:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2351:x1875232130346752:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 48us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360870.540126:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788360870.540137:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788360870.540142:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2351:x1875232130346880:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360870.540165:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2351:x1875232130346880:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 23us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360870.540170:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788360870.540189:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130346368 00000100:00100000:1.0:1788360870.540193:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130346368 00000100:00100000:1.0:1788360870.540220:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:1.0:1788360870.540227:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2351:x1875232130346368:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360870.540278:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2351:x1875232130346368:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 51us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360870.540285:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00080000:1.0:1788360870.540623:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788360870.540628:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788360870.540632:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788360870.624372:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360871.650234:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360872.672338:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360873.699054:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360874.145811:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144008192:0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.145811:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144007936:0@lo:400:kworker.0 00000100:00100000:3.0:1788360874.145912:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360874.145975:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360874.145996:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788360874.146004:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144008320:0@lo:400:kworker.0 00000100:00100000:3.0:1788360874.146050:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360874.146216:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144008448:0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.146258:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360874.146278:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788360874.146284:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144008064:0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.146312:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360874.146356:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144008576:0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.146382:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360874.146445:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144008192 00000100:00100000:1.0:1788360874.146448:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144008448 00000100:00100000:1.0:1788360874.146455:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144008448 00000100:00100000:0.0:1788360874.146464:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144008192 00000100:00100000:0.0:1788360874.146525:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144008064 00000100:00100000:0.0:1788360874.146529:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144008064 00000100:00100000:1.0:1788360874.146534:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788360874.146547:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144008192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.146559:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788360874.146569:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144008448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.146637:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144008448:12345-0@lo:400:kworker.0 Request processed in 69us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360874.146640:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144008192:12345-0@lo:400:kworker.0 Request processed in 96us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360874.146651:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788360874.147252:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144008192:0@lo:400:kworker.0 00000100:00100000:3.0:1788360874.147280:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144008704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360874.147332:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360874.147374:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144008704 00000100:00100000:2.0:1788360874.147381:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144008704 00000100:00100000:2.0:1788360874.147428:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788360874.147437:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144008704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788360874.147480:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1788360874.148764:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc431500 x1875232144008704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360874.148798:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144008704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360874.148816:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144008704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1298us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360874.148830:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788360874.150218:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788360874.150239:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788360874.150261:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144008064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.150427:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144008064:12345-0@lo:400:kworker.0 Request processed in 175us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360874.150434:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788360874.150586:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144008320 00000100:00100000:0.0:1788360874.150595:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144008320 00000100:00100000:0.0:1788360874.150941:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144008576 00000100:00100000:0.0:1788360874.150946:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144008576 00000100:00100000:0.0:1788360874.150977:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788360874.150985:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144008320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.151037:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144008320:12345-0@lo:400:kworker.0 Request processed in 52us (4985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360874.151044:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788360874.151056:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788360874.151677:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc894700 x1875232144008320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360874.151712:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144008320:0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.151720:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144008576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.151778:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144008576:12345-0@lo:400:kworker.0 Request processed in 715us (5394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360874.151785:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788360874.151813:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144007936 00000100:00100000:0.0:1788360874.151818:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144007936 00000100:00100000:0.0:1788360874.151848:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788360874.151856:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144007936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.151898:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144007936:12345-0@lo:400:kworker.0 Request processed in 43us (5924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360874.151906:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788360874.151964:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144008064:0@lo:400:kworker.0 00010000:00080000:0.0:1788360874.151980:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc895180 x1875232144008576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360874.151991:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144008576:0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.152147:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144007936:0@lo:400:kworker.0 00000100:00100000:0.0:1788360874.152167:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144008448:0@lo:400:kworker.0 00000100:00080000:2.0:1788360874.153035:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788360874.153043:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788360874.153048:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360874.660771:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360874.660805:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144008832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788360874.660907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360874.660987:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144008832 00000100:00100000:0.0:1788360874.661007:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144008832 00000100:00100000:0.0:1788360874.661066:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788360874.661076:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144008832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788360874.661153:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360874.661241:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144008832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360874.661250:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788360874.661309:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc894a80 x1875232144008832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360874.661334:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144008832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788360874.720276:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360875.658065:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360875.658316:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130347136 00000100:00100000:1.0:1788360875.658326:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130347136 00000100:00100000:1.0:1788360875.658398:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:1.0:1788360875.658409:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130347136:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360875.658508:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130347136:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 101us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360875.658516:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00080000:2.0:1788360875.658575:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788360875.661544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360875.661587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360875.661620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360875.661674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360875.661752:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130347008 00000100:00100000:2.0:1788360875.661763:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130347008 00000100:00100000:2.0:1788360875.661813:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:2.0:1788360875.661821:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130347008:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360875.661884:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130347008:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 63us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360875.661891:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:2.0:1788360875.661921:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130347520 00000100:00100000:2.0:1788360875.661925:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130347520 00000100:00100000:2.0:1788360875.661966:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130347392 00000100:00100000:2.0:1788360875.661969:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130347392 00000100:00100000:2.0:1788360875.661990:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1788360875.661996:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130347520:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360875.662025:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130347520:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360875.662031:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1788360875.662042:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788360875.662047:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130347392:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360875.662068:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130347392:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 21us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360875.662073:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00080000:2.0:1788360875.662117:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788360875.662122:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788360875.662516:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130347264 00000100:00100000:0.0:1788360875.662522:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130347264 00000100:00100000:0.0:1788360875.662572:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1788360875.662580:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130347264:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360875.662618:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130347264:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 40us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360875.662625:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00080000:2.0:1788360875.663016:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788360875.744367:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360876.768279:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360877.792411:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360878.816220:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360879.267062:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144009088:0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267144:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360879.267197:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144009600:0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267238:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360879.267275:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788360879.267281:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232144008960:0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267307:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360879.267327:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144009472:0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267345:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360879.267367:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144009216:0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360879.267410:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360879.267415:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144009344:0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267434:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360879.267458:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144009088 00000100:00100000:0.0:1788360879.267465:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144009088 00000100:00100000:0.0:1788360879.267502:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144009472 00000100:00100000:0.0:1788360879.267504:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144009472 00000100:00100000:0.0:1788360879.267523:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144009216 00000100:00100000:0.0:1788360879.267525:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144009216 00000100:00100000:0.0:1788360879.267539:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788360879.267546:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144009088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267590:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144009088:12345-0@lo:400:kworker.0 Request processed in 44us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360879.267596:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788360879.267611:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788360879.267616:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144009472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267639:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144009472:12345-0@lo:400:kworker.0 Request processed in 23us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360879.267644:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788360879.267653:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788360879.267658:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144009216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267683:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144009216:12345-0@lo:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360879.267688:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788360879.267725:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144009216:0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267750:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144009472:0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267771:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144009088:0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267811:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144008960 00000100:00100000:0.0:1788360879.267814:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144008960 00000100:00100000:0.0:1788360879.267838:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788360879.267844:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232144008960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267876:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232144008960:12345-0@lo:400:kworker.0 Request processed in 32us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360879.267882:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788360879.267911:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232144008960:0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.267939:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144009600 00000100:00100000:0.0:1788360879.267942:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144009600 00000100:00100000:0.0:1788360879.267963:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144009344 00000100:00100000:0.0:1788360879.267965:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144009344 00000100:00100000:0.0:1788360879.267981:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788360879.267986:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144009600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.268016:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144009600:12345-0@lo:400:kworker.0 Request processed in 30us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360879.268022:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788360879.268031:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788360879.268036:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144009344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360879.268061:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144009344:12345-0@lo:400:kworker.0 Request processed in 25us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360879.268066:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788360879.268109:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc894e00 x1875232144009344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360879.268131:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144009344:0@lo:400:kworker.0 00010000:00080000:0.0:1788360879.268154:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc894700 x1875232144009600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360879.268161:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144009600:0@lo:400:kworker.0 00000100:00080000:0.0:1788360879.268179:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788360879.268183:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788360879.268185:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360879.273160:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788360879.273180:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144009728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360879.273254:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360879.273296:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144009728 00000100:00100000:2.0:1788360879.273304:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144009728 00000100:00100000:2.0:1788360879.273348:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788360879.273356:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144009728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788360879.273391:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788360879.273434:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144009728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360879.273441:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788360879.273490:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab6da7100 x1875232144009728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360879.273507:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144009728:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788360879.497437:0:10866:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788360879.776442:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144009856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788360879.776536:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360879.777506:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144009856 00000100:00100000:0.0:1788360879.777516:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144009856 00000100:00100000:0.0:1788360879.777687:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788360879.777700:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144009856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788360879.777746:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360879.777840:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144009856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360879.777847:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788360879.777942:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab7143480 x1875232144009856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360879.777961:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144009856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788360879.841055:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360880.779379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360880.779417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360880.779437:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360880.779458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360880.779492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360880.779521:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130347648 00000100:00100000:0.0:1788360880.779530:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130347648 00000100:00100000:0.0:1788360880.779573:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:0.0:1788360880.779583:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2351:x1875232130347648:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360880.779653:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2351:x1875232130347648:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 71us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360880.779667:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:0.0:1788360880.779700:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130347904 00000100:00100000:0.0:1788360880.779704:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130347904 00000100:00100000:0.0:1788360880.779736:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130347776 00000100:00100000:0.0:1788360880.779739:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130347776 00000100:00100000:0.0:1788360880.779761:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:0.0:1788360880.779767:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2351:x1875232130347904:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360880.779798:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2351:x1875232130347904:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 31us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360880.779804:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:0.0:1788360880.779815:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:0.0:1788360880.779820:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2351:x1875232130347776:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360880.779840:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2351:x1875232130347776:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 20us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360880.779846:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:0.0:1788360880.779866:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130348032 00000100:00100000:0.0:1788360880.779870:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130348032 00000100:00100000:0.0:1788360880.779893:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130348160 00000100:00100000:0.0:1788360880.779896:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130348160 00000100:00100000:0.0:1788360880.779914:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788360880.779919:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2348:x1875232130348032:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1788360880.779938:0:6594:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661030c 00000100:00080000:0.0:1788360880.779946:0:6594:0:(import.c:65:import_set_state_nolock()) ffff9a8ac0a1a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788360880.780000:0:6594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788360880.780377:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+2:2348:x1875232130348032:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 456us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360880.780393:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788360880.780408:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1788360880.780414:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2348:x1875232130348160:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1788360880.780427:0:6594:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6610313 00000100:00080000:0.0:1788360880.780433:0:6594:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788360880.780452:0:6594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788360880.780642:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+2:2348:x1875232130348160:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 227us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360880.780649:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00080000:0.0:1788360880.780756:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788360880.780760:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788360880.780763:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788360880.780788:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360880.784826:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360880.868420:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360881.888323:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788360881.925494:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 67937cdd-2aa9-412f-a448-3db0f2b2b807 00000020:00000080:2.0:1788360881.925503:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8ac0a1d800/67937cdd-2aa9-412f-a448-3db0f2b2b807 00000020:00000080:0.0:1788360881.925620:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac0a1d800/67937cdd-2aa9-412f-a448-3db0f2b2b807 for lustre-OST0000 00000020:00000080:0.0:1788360881.925668:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ac0a1a800 for lustre-OST0000 00000020:00000080:2.0:1788360882.499533:0:11016:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe2c0eda0 20000000:00000080:2.0:1788360882.499551:0:11016:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8ac0866800 uarg=0000000000000000 20000000:01000000:2.0:1788360882.499587:0:11016:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788360882.499593:0:11016:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788360882.499598:0:11016:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788360882.500549:0:11017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788360882.500680:0:11016:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788360882.516640:0:11016:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788360882.516902:0:11016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.516925:0:11016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e12d expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.516934:0:11016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a813cb400/0xf6a94c97d66102cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66102c6 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.516941:0:11016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d66102db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66102d4 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.516961:0:11016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d66102e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66102e2 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.516969:0:11016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d66102fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e165 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.516975:0:11016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.517072:0:11016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d66102fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e165 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.517192:0:11016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d66102fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e165 expref: 12 pid: 5791 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360882.517210:0:11016:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11016:1875232144009984:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360882.517332:0:11016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d66102e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66102e2 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.517342:0:11016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d66102e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66102e2 expref: 18 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360882.517351:0:11016:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11016:1875232144010112:0@lo:104: 00000100:00100000:2.0:1788360882.517396:0:11016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788360882.517437:0:11016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d66102db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66102d4 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.517446:0:11016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d66102db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66102d4 expref: 18 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360882.517465:0:11016:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11016:1875232144010240:0@lo:104: 00000100:00100000:3.0:1788360882.517472:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144010112 00000100:00100000:3.0:1788360882.517481:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144010112 00000100:00100000:2.0:1788360882.517499:0:11016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360882.517532:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144010240 00000100:00100000:3.0:1788360882.517537:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144010240 00010000:00010000:2.0:1788360882.517541:0:11016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a813cb400/0xf6a94c97d66102cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66102c6 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360882.517556:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788360882.517558:0:11016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a813cb400/0xf6a94c97d66102cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66102c6 expref: 18 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360882.517577:0:11016:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11016:1875232144010368:0@lo:104: 00000100:00100000:1.0:1788360882.517587:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:11016:x1875232144010112:12345-0@lo:104: 00000100:00100000:2.0:1788360882.517604:0:11016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788360882.517614:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.517629:0:11016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e12d expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.517641:0:11016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e12d expref: 12 pid: 5791 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360882.517774:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788360882.517784:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:11016:x1875232144010112:12345-0@lo:104: Request processed in 210us (387us total) trans 0 rc 0/0 00010000:00010000:1.0:1788360882.517817:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788360882.517825:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.517861:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a813ca200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788360882.517866:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.517875:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788360882.517882:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360882.517888:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788360882.517929:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.517937:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788360882.517963:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.517970:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca200/0xf6a94c97d66102e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66102e9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360882.517981:0:11016:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11016:1875232144010496:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360882.517987:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360882.517990:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360882.517992:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360882.518017:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144010624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788360882.518065:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360882.518159:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144010624 00000100:00100000:1.0:1788360882.518175:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144010624 00010000:00010000:1.0:1788360882.518203:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d66102e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66102e2 expref: 19 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360882.518252:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788360882.518260:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144010624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788360882.518273:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360882.518280:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d66102e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66102e2 expref: 19 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.518289:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d66102e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66102e2 expref: 19 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.518310:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360882.518349:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144010624:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360882.518357:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788360882.518367:0:11016:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788360882.518400:0:5781:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:2.0:1788360882.518408:0:11016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d66102e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66102e2 expref: 18 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360882.518411:0:5781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788360882.518428:0:11016:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11016:1875232144010112:0@lo:104: 00000100:00100000:1.0:1788360882.518469:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144010624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788360882.519342:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144010368 00000100:00100000:2.0:1788360882.519351:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144010368 00000100:00100000:1.0:1788360882.519474:0:11018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788360882.519486:0:11018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:11016:x1875232144010240:12345-0@lo:104: 00010000:00010000:1.0:1788360882.519506:0:11018:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360882.519538:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788360882.519562:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788360882.519571:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:11016:x1875232144010368:12345-0@lo:104: 00010000:00010000:1.0:1788360882.519579:0:11018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788360882.519581:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360882.519585:0:11018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:11016:x1875232144010240:12345-0@lo:104: Request processed in 103us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360882.519591:0:11018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788360882.519609:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788360882.519620:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360882.519626:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788360882.519632:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360882.519637:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.519641:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788360882.519651:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:11016:x1875232144010368:12345-0@lo:104: Request processed in 78us (2045us total) trans 0 rc 0/0 00010000:00010000:3.0:1788360882.519672:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360882.519682:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788360882.519690:0:11016:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11016:1875232144010240:0@lo:104: 10000000:00010000:3.0:1788360882.519693:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360882.519704:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788360882.519720:0:11016:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11016:1875232144010368:0@lo:104: 00010000:00010000:3.0:1788360882.519754:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360882.519773:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360882.519814:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360882.519822:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66102d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66102db expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360882.519836:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360882.519838:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360882.519839:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360882.519848:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788360882.519861:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144010752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788360882.519917:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788360882.520276:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360882.520280:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360882.520282:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360882.520301:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.520325:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ae00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788360882.520334:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.520342:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788360882.520350:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360882.520356:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788360882.520397:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.520404:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788360882.520429:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.520436:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586ae00/0xf6a94c97d66102c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66102cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360882.520457:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360882.520461:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360882.520467:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360882.520490:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144010752 00000100:00100000:2.0:1788360882.520505:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144010752 00010000:00010000:2.0:1788360882.520536:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d66102db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66102d4 expref: 18 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360882.520569:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788360882.520578:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:3311:x1875232144010752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788360882.520592:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360882.520597:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d66102db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66102d4 expref: 18 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.520606:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d66102db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66102d4 expref: 18 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.520621:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813cb000/0xf6a94c97d66102db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66102d4 expref: 18 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.520634:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360882.522347:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:3311:x1875232144010752:12345-0@lo:103:ldlm_bl.0 Request processed in 1762us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360882.522360:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788360882.522522:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144010752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788360882.522562:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144010880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788360882.522599:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360882.522863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360882.522905:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144010880 00000100:00100000:3.0:1788360882.522914:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144010880 00010000:00010000:3.0:1788360882.522947:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a813cb400/0xf6a94c97d66102cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66102c6 expref: 17 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360882.523329:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130348288 00000100:00100000:2.0:1788360882.523334:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130348288 00010000:00010000:2.0:1788360882.523354:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d66102fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e165 expref: 13 pid: 5791 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360882.523377:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788360882.523384:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:3313:x1875232144010880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788360882.523396:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360882.523401:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a813cb400/0xf6a94c97d66102cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66102c6 expref: 17 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.523427:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a813cb400/0xf6a94c97d66102cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66102c6 expref: 17 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.523443:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813cb400/0xf6a94c97d66102cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66102c6 expref: 17 pid: 5789 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.523458:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360882.523498:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:3313:x1875232144010880:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360882.523505:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788360882.523518:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:2.0:1788360882.523524:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130348288:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360882.523536:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360882.523541:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d66102fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e165 expref: 13 pid: 5791 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.523553:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d66102fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e165 expref: 13 pid: 5791 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.523563:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360882.523603:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130348288:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 79us (752us total) trans 0 rc 0/0 00010000:00010000:1.0:1788360882.523615:0:11016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d66102fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e165 expref: 13 pid: 5791 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360882.523616:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:1.0:1788360882.523645:0:11016:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11016:1875232144009984:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360882.523659:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144010880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788360882.523707:0:11016:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11016:1875232144010496:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360882.523777:0:11016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360882.526422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360882.527586:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130348416 00000100:00100000:2.0:1788360882.527600:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130348416 00010000:00010000:2.0:1788360882.527647:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e12d expref: 12 pid: 5791 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360882.527863:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:2.0:1788360882.527888:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:2350:x1875232130348416:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360882.527907:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360882.527914:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e12d expref: 12 pid: 5791 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.527926:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e12d expref: 12 pid: 5791 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.527954:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586a600/0xf6a94c97d66102bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e12d expref: 12 pid: 5791 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.527980:0:7487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.527989:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.528007:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.528014:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.528021:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.528036:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.528054:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788360882.528058:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.528066:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.528107:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360882.528119:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360882.528193:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:2350:x1875232130348416:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 320us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360882.528201:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00010000:00010000:3.0:1788360882.528336:0:11016:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360882.528347:0:11016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360882.528354:0:11016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661031a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360882.915010:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788360883.873574:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788360883.873583:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a898534c800 from 7 10000000:01000000:1.0:1788360883.873588:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788360883.873637:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360883.873649:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360883.873662:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360883.873687:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788360883.873757:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360883.873948:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788360883.874036:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144011008 00000100:00100000:2.0:1788360883.874044:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144011008 00000100:00100000:2.0:1788360883.874187:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788360883.874197:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232144011008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360883.874210:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360883.874224:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d6610328 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610321 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.874246:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d6610328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610321 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.874257:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d6610328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610321 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.874264:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e200, rc 0) 00000100:00100000:2.0:1788360883.874319:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144011008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360883.874326:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788360883.874401:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788360883.874417:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360883.874426:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360883.874481:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788360883.874510:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360883.874541:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788360883.874641:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144011136 00000100:00100000:1.0:1788360883.874645:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144011136 00000100:00100000:1.0:1788360883.874679:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788360883.874686:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144011136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360883.874940:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144011136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360883.874947:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788360883.874979:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788360883.875009:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788360883.875047:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360883.875069:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788360883.875137:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144011264 00000100:00100000:2.0:1788360883.875142:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144011264 00000100:00100000:2.0:1788360883.875186:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788360883.875194:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144011264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788360883.875370:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144011264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360883.875377:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788360883.875434:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788360883.876760:0:11074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788360883.877024:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788360883.877041:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788360883.877051:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360883.877164:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360883.877175:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788360883.877178:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a86b49000 from 7 10000000:01000000:1.0:1788360883.877180:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788360883.877211:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360883.877219:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360883.877229:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360883.877251:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788360883.877307:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360883.877349:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788360883.877380:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144011392 00000100:00100000:2.0:1788360883.877389:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144011392 00000100:00100000:2.0:1788360883.877435:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788360883.877444:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144011392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360883.877456:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360883.877486:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6610336 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661032f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.877510:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6610336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661032f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.877521:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6610336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661032f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.877539:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:2.0:1788360883.877586:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144011392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360883.877594:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788360883.877613:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788360883.877629:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360883.877637:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360883.877701:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788360883.877726:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360883.877743:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788360883.877881:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144011520 00000100:00100000:2.0:1788360883.877886:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144011520 00000100:00100000:2.0:1788360883.877911:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788360883.877918:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144011520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788360883.878219:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144011520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360883.878237:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788360883.878594:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788360883.878627:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788360883.878675:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360883.878704:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788360883.879382:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144011648 00000100:00100000:1.0:1788360883.879389:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144011648 00000100:00100000:1.0:1788360883.879431:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788360883.879440:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144011648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360883.879607:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144011648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360883.879614:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788360883.880897:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788360883.882787:0:11075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788360883.882990:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788360883.883004:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788360883.883012:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360883.883028:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788360883.883036:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788360883.883038:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a83778000 from 7 10000000:01000000:1.0:1788360883.883040:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788360883.883068:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360883.883076:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360883.883109:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360883.883134:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788360883.883207:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360883.883247:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab780 going to sleep for 11 seconds 00000100:00100000:2.0:1788360883.883376:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144011776 00000100:00100000:2.0:1788360883.883384:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144011776 00000100:00100000:2.0:1788360883.883430:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788360883.883438:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144011776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360883.883452:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360883.883509:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d6610344 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661033d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.883533:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d6610344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661033d expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.883544:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d6610344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661033d expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.883553:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fc00, rc 0) 00000100:00100000:2.0:1788360883.883627:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232144011776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360883.883632:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788360883.883694:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788360883.883708:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360883.883716:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360883.883761:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360883.883785:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360883.883857:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab780 going to sleep for 11 seconds 00000100:00100000:2.0:1788360883.883896:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144011904 00000100:00100000:2.0:1788360883.883900:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144011904 00000100:00100000:2.0:1788360883.883958:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788360883.883966:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232144011904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788360883.884242:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232144011904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360883.884248:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788360883.884314:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144011904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788360883.884343:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144012032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788360883.884385:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360883.884414:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788360883.884647:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144012032 00000100:00100000:2.0:1788360883.884652:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144012032 00000100:00100000:2.0:1788360883.884686:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788360883.884696:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232144012032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788360883.884835:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232144012032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360883.884842:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788360883.884913:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144012032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788360883.886348:0:11076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788360883.886585:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788360883.886606:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788360883.886617:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360883.886629:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360883.912233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360883.914638:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130348544 00000100:00100000:3.0:1788360883.914653:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130348544 00000100:00100000:3.0:1788360883.914721:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00100000:3.0:1788360883.914731:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:5562:x1875232130348544:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788360883.914748:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360883.914769:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d661034b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e18f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360883.914823:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d661034b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e18f expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360883.914835:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d661034b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e18f expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360883.914845:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fa00, rc 0) 00000100:00100000:3.0:1788360883.914915:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130348544:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 185us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360883.914922:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00100000:0.0:1788360883.917643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360883.917738:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130348672 00000100:00100000:1.0:1788360883.917748:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130348672 00000100:00100000:1.0:1788360883.917803:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:1.0:1788360883.917812:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130348672:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360883.918081:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130348672:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 269us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360883.918114:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:0.0:1788360883.921685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360883.925987:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130348800 00000100:00100000:1.0:1788360883.926003:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130348800 00000100:00100000:1.0:1788360883.926065:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 230 00000100:00100000:1.0:1788360883.926076:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130348800:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360883.926323:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130348800:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 249us (4647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360883.926331:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 230 00000100:00100000:0.0:1788360883.941220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360883.944189:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130348928 00000100:00100000:2.0:1788360883.944201:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130348928 00000100:00100000:2.0:1788360883.944697:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:2.0:1788360883.944709:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130348928:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360883.944727:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360883.944742:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d6610352 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e196 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.944767:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d6610352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e196 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.944778:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d6610352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e196 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360883.944787:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ea00, rc 0) 00000100:00100000:2.0:1788360883.944998:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:5562:x1875232130348928:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 291us (3785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360883.945015:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:3.0:1788360883.949265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360883.953050:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130349056 00000100:00100000:0.0:1788360883.953064:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130349056 00000100:00100000:0.0:1788360883.953135:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 232 00000100:00100000:0.0:1788360883.953146:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:5562:x1875232130349056:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360883.953430:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:5562:x1875232130349056:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 286us (4172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360883.953438:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 232 00010000:00010000:0.0:1788360883.953471:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360883.958282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360883.958316:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130349184 00000100:00100000:0.0:1788360883.958325:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130349184 00000100:00100000:0.0:1788360883.958367:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:0.0:1788360883.958375:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:5562:x1875232130349184:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360883.958576:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:5562:x1875232130349184:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 200us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360883.958584:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:3.0:1788360884.384375:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144012160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360884.384449:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360884.384515:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144012416:0@lo:400:kworker.0 00000100:00100000:3.0:1788360884.384516:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144012672:0@lo:400:kworker.0 00000100:00100000:3.0:1788360884.384557:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360884.384571:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144012160 00000100:00100000:2.0:1788360884.384574:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144012544:0@lo:400:kworker.0 00000100:00100000:1.0:1788360884.384582:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144012160 00000100:00100000:3.0:1788360884.384610:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144012288:0@lo:400:kworker.0 00000100:00100000:2.0:1788360884.384625:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360884.384651:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360884.384655:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788360884.384670:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144012160:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360884.384671:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144012672 00000100:00100000:2.0:1788360884.384677:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144012672 00000100:00100000:3.0:1788360884.384697:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144012800:0@lo:400:kworker.0 00000100:00100000:2.0:1788360884.384714:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144012544 00000100:00100000:2.0:1788360884.384718:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144012544 00000100:00100000:3.0:1788360884.384740:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360884.384749:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788360884.384762:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144012672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360884.384783:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00002000:00000024:1.0:1788360884.384793:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788360884.384795:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144012544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360884.384828:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144012672:12345-0@lo:400:kworker.0 Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360884.384838:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788360884.384865:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144012544:12345-0@lo:400:kworker.0 Request processed in 72us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360884.384873:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788360884.384903:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144012288 00000100:00100000:3.0:1788360884.384907:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144012288 00000100:00100000:1.0:1788360884.384935:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144012160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360884.384946:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788360884.384969:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788360884.384973:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788360884.384992:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788360884.385000:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144012288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360884.385045:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144012288:12345-0@lo:400:kworker.0 Request processed in 46us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360884.385051:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788360884.385136:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144012288:0@lo:400:kworker.0 00000100:00100000:3.0:1788360884.390523:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144012800 00000100:00100000:3.0:1788360884.390539:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144012800 00000100:00100000:3.0:1788360884.390654:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788360884.390665:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144012800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360884.390775:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144012800:12345-0@lo:400:kworker.0 Request processed in 112us (6035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360884.390782:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788360884.390808:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360884.390877:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144012544:0@lo:400:kworker.0 00010000:00080000:3.0:1788360884.390909:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab6da6300 x1875232144012800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360884.390920:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144012800:0@lo:400:kworker.0 00000100:00100000:3.0:1788360884.390974:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144012672:0@lo:400:kworker.0 00010000:00080000:3.0:1788360884.390986:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab6da6680 x1875232144012160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360884.391003:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144012160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360884.391066:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144012416 00000100:00100000:2.0:1788360884.391071:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144012416 00000100:00100000:2.0:1788360884.391184:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788360884.391192:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144012416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360884.391232:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144012416:12345-0@lo:400:kworker.0 Request processed in 42us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360884.391239:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788360884.391264:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144012416:0@lo:400:kworker.0 00000100:00080000:1.0:1788360884.392761:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788360884.900597:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144012928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788360884.900675:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360884.900743:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144012928 00000100:00100000:0.0:1788360884.900750:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144012928 00000100:00100000:0.0:1788360884.900795:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788360884.900803:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144012928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788360884.900838:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360884.900881:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144012928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360884.900888:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788360884.900926:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab7141880 x1875232144012928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360884.900944:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144012928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788360884.960283:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788360885.469406:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 67937cdd-2aa9-412f-a448-3db0f2b2b807 00000020:00000080:2.0:1788360885.469480:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8ab76db000/67937cdd-2aa9-412f-a448-3db0f2b2b807 00000020:00000080:3.0:1788360885.469538:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76db000/67937cdd-2aa9-412f-a448-3db0f2b2b807 for lustre-OST0001 00000020:00000080:3.0:1788360885.469587:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83e4e800 for lustre-OST0001 00000001:02000400:2.0:1788360885.625485:0:11216:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788360885.896694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360885.896743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360885.896775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360885.896808:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130349312 00000100:00100000:1.0:1788360885.896818:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130349312 00000100:00100000:3.0:1788360885.896852:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130349440 00000100:00100000:3.0:1788360885.896856:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130349440 00000100:00100000:1.0:1788360885.896882:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:1.0:1788360885.896891:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130349312:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360885.896892:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130349568 00000100:00100000:3.0:1788360885.896895:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130349568 00000100:00100000:3.0:1788360885.896912:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:3.0:1788360885.896918:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130349440:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360885.896953:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130349312:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 63us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360885.896960:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00080000:1.0:1788360885.897015:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360885.897025:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:1.0:1788360885.897116:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130349568:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360885.898646:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130349440:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1719us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360885.898657:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:1.0:1788360885.901617:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130349568:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 4558us (4830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360885.901631:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00010000:00010000:3.0:1788360885.984581:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360887.008481:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360888.032324:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788360888.676710:0:11316:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:54:48 (1788360888) === 00000100:00100000:0.0:1788360888.879285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360888.879546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360888.879576:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130349696 00000100:00100000:0.0:1788360888.879586:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130349696 00000100:00080000:1.0:1788360888.879612:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360888.879705:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788360888.879716:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130349696:12345-192.168.203.60@tcp:41:mkdir.0 00000004:00000024:0.0:1788360888.879764:0:5799:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788360888.879862:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130349696:12345-192.168.203.60@tcp:41:mkdir.0 Request processed in 147us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360888.879870:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788360888.880762:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130349824 00000100:00100000:0.0:1788360888.880781:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130349824 00000100:00100000:0.0:1788360888.880813:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788360888.880822:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:9638:x1875232130349824:12345-192.168.203.60@tcp:700:mkdir.0 00000100:00100000:0.0:1788360888.880875:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:9638:x1875232130349824:12345-192.168.203.60@tcp:700:mkdir.0 Request processed in 54us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360888.880882:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788360888.883380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360888.883786:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130350080 00000100:00100000:2.0:1788360888.883797:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130350080 00000100:00100000:2.0:1788360888.883855:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788360888.883865:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:9638:x1875232130350080:12345-192.168.203.60@tcp:36:mkdir.0 00010000:00010000:2.0:1788360888.883922:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360888.883990:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d661023a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e118 expref: 6 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.884008:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526d00) 00010000:00010000:2.0:1788360888.884018:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788360888.884365:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610359 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.884379:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610359 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.884390:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610359 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.884401:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.884408:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.884415:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360888.893611:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788360888.893631:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610359 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.894389:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610359 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.894397:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610359 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.894403:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360888.894407:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610359 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.894415:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610359 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.894431:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1e00) 00010000:00010000:2.0:1788360888.894434:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360888.894439:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610359 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.894445:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610359 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360888.894468:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4acef79 reply state 000000001d5ce88e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360888.894477:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788360888.894961:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:9638:x1875232130350080:12345-192.168.203.60@tcp:36:mkdir.0 Request processed in 11093us (11586us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788360888.894972:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00010000:00010000:3.0:1788360888.900004:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.900023:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.900031:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.900037:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360888.900042:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.900050:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.900069:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a8aa8ee1800) 00010000:00010000:3.0:1788360888.900072:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360888.900077:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.900130:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6610360 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360888.913863:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360888.913987:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130350208 00000100:00100000:1.0:1788360888.913997:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130350208 00000100:00100000:1.0:1788360888.914144:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1788360888.914157:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:9639:x1875232130350208:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:1.0:1788360888.914180:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360888.914204:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e19d expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.914269:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661036e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.914284:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661036e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.914296:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661036e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360888.914362:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788360888.914366:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360888.914404:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661036e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.914430:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e19d expref: 8 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.914449:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661036e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e19d expref: 7 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.914457:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99640000) 00010000:00010000:1.0:1788360888.914460:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788360888.914464:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705bc00, rc 0) 00000100:00100000:1.0:1788360888.914535:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:9639:x1875232130350208:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 381us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360888.914549:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788360888.922447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360888.922528:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130350464 00000100:00100000:1.0:1788360888.922538:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130350464 00000100:00100000:1.0:1788360888.922597:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788360888.922607:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:9639:x1875232130350464:12345-192.168.203.60@tcp:36:chmod.0 00010000:00010000:1.0:1788360888.922656:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360888.922681:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661036e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e19d expref: 7 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.922699:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99640000) 00010000:00010000:1.0:1788360888.922708:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788360888.922729:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.922741:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.922750:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788360888.923050:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab1cd97c reply state 00000000a377fdba transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360888.923060:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788360888.923072:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788360888.923203:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:9639:x1875232130350464:12345-192.168.203.60@tcp:36:chmod.0 Request processed in 597us (788us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788360888.923211:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00010000:00010000:0.0:1788360888.925534:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360888.925551:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360888.925558:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360888.925564:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360888.925569:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360888.925576:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360888.925596:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99640600) 00010000:00010000:0.0:1788360888.925599:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788360888.925604:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360888.925609:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610375 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360888.961961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360888.962211:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130350592 00000100:00100000:2.0:1788360888.962221:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130350592 00000100:00100000:2.0:1788360888.962290:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788360888.962300:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:9640:x1875232130350592:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788360888.962322:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360888.962347:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661037c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1a4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.964042:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610383 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.964065:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610383 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.964080:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610383 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360888.964258:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788360888.964263:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360888.964316:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610383 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.964354:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661037c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1a4 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.964418:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610383 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1a4 expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360888.964427:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1e00) 00010000:00010000:2.0:1788360888.964430:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788360888.964433:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:2.0:1788360888.967576:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:9640:x1875232130350592:12345-192.168.203.60@tcp:101:chown.0 Request processed in 5264us (5612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360888.967609:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788360888.978640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360888.978702:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130350720 00000100:00100000:3.0:1788360888.978712:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130350720 00000100:00100000:3.0:1788360888.978893:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788360888.978905:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:9640:x1875232130350720:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:3.0:1788360888.978928:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360888.978947:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661038a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1ab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979028:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610391 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979043:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610391 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979054:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610391 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979068:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610398 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979076:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610398 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979083:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610398 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979241:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661039f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979281:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661039f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979290:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661039f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360888.979333:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788360888.979337:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788360888.979363:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661039f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979376:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610391 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979384:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610391 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979390:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610391 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979396:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360888.979401:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610391 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979408:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610391 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979421:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1e00) 00010000:00010000:3.0:1788360888.979424:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360888.979429:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610391 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979445:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610391 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979460:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610398 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979466:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610398 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979472:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610398 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979477:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360888.979480:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610398 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979486:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610398 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979494:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a8a99526d00) 00010000:00010000:3.0:1788360888.979496:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360888.979499:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610398 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979505:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610398 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979535:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661038a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ab expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979548:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661039f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ab expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360888.979566:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99526400) 00010000:00010000:3.0:1788360888.979568:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788360888.979571:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e400, rc 0) 00000100:00100000:3.0:1788360888.979639:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:9640:x1875232130350720:12345-192.168.203.60@tcp:101:chown.0 Request processed in 737us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360888.979647:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788360888.985248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360888.985328:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130350976 00000100:00100000:1.0:1788360888.985357:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130350976 00000100:00100000:1.0:1788360888.985487:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788360888.985500:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:9640:x1875232130350976:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:1.0:1788360888.985553:0:6736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360888.985581:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661039f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ab expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.985602:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99526400) 00010000:00010000:1.0:1788360888.985611:0:6736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788360888.985635:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.985646:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360888.985655:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788360889.034102:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788360889.034249:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a259f3fe reply state 00000000bf10d814 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360889.034263:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788360889.034474:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1788360889.034585:0:6736:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788360889.034607:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:9640:x1875232130350976:12345-192.168.203.60@tcp:36:chown.0 Request processed in 49106us (49365us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788360889.034617:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00010000:00010000:3.0:1788360889.034794:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.034804:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.034813:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.034819:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360889.034822:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.034828:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.034844:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99640000) 00010000:00010000:3.0:1788360889.034845:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788360889.034849:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.034853:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66103a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360889.054203:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360889.054299:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130351104 00000100:00100000:1.0:1788360889.054310:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130351104 00000100:00100000:1.0:1788360889.054374:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788360889.054385:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:9641:x1875232130351104:12345-192.168.203.60@tcp:101:touch.500 00010000:00010000:1.0:1788360889.054409:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360889.054430:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66103ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1b2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.056735:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788360889.056935:0:5797:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2202us 00010000:00010000:1.0:1788360889.071653:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66103b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.071676:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66103b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.071694:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66103b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.071709:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66103bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.071781:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66103bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.071788:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66103bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072225:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ae00/0xf6a94c97d66103c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072235:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ae00/0xf6a94c97d66103c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072243:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ae00/0xf6a94c97d66103c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360889.072317:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788360889.072322:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360889.072433:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ae00/0xf6a94c97d66103c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072446:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66103b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072453:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66103b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072469:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66103b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072477:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360889.072482:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66103b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072490:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66103b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072501:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1e00) 00010000:00010000:1.0:1788360889.072504:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360889.072508:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66103b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072514:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66103b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072523:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66103bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072529:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66103bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.072533:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66103bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.073004:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360889.073008:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66103bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.073025:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66103bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.073035:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a8a99640b00) 00010000:00010000:1.0:1788360889.073037:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360889.073040:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66103bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.073045:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66103bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.073323:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66103ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1b2 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.073339:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ae00/0xf6a94c97d66103c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1b2 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.073347:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99640e00) 00010000:00010000:1.0:1788360889.073349:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788360889.073352:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705ae00, rc 0) 00000100:00100000:1.0:1788360889.073606:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:9641:x1875232130351104:12345-192.168.203.60@tcp:101:touch.500 Request processed in 19153us (19343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360889.073618:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788360889.079006:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360889.079153:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130351360 00000100:00100000:2.0:1788360889.079165:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130351360 00000100:00100000:2.0:1788360889.079330:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:2.0:1788360889.079341:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:9641:x1875232130351360:12345-192.168.203.60@tcp:101:touch.500 00010000:00010000:2.0:1788360889.079363:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360889.079382:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66103c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1b9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.079723:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66103d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.079737:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66103d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.079749:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66103d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.079810:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.079818:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.079825:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788360889.080735:0:5799:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788360889.080989:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66103de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081000:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66103de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081010:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66103de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081042:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66103d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081049:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66103d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081055:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66103d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081060:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360889.081064:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66103d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081071:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66103d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081082:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99640e00) 00010000:00010000:2.0:1788360889.081109:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360889.081113:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66103d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081141:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66103d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360889.081152:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c3acfcab reply state 000000003e88c682 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360889.081160:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788360889.081191:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66103c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1b9 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081204:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66103de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1b9 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.081211:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:2.0:1788360889.081213:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360889.081216:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:2.0:1788360889.081286:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:9641:x1875232130351360:12345-192.168.203.60@tcp:101:touch.500 Request processed in 1947us (2290us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788360889.081295:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00010000:00010000:0.0:1788360889.085494:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.085512:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.085520:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.085527:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360889.085532:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.085539:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.085558:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7e4cf8fb (ffff9a8aa8ee1800) 00010000:00010000:0.0:1788360889.085577:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360889.085582:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.085589:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66103d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360889.091573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360889.091706:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130351616 00000100:00100000:3.0:1788360889.091718:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130351616 00000100:00100000:3.0:1788360889.092357:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788360889.092370:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:9641:x1875232130351616:12345-192.168.203.60@tcp:36:touch.500 00010000:00010000:3.0:1788360889.092436:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360889.092465:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66103de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1b9 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.092483:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:3.0:1788360889.092494:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360889.092568:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.092589:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.092600:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788360889.092732:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003466e526 reply state 00000000d484617d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360889.092741:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788360889.094003:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:9641:x1875232130351616:12345-192.168.203.60@tcp:36:touch.500 Request processed in 1630us (2432us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788360889.094013:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00010000:00010000:3.0:1788360889.099558:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.099589:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.099597:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.099603:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360889.099607:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.099615:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.099632:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a8a99526200) 00010000:00010000:3.0:1788360889.099635:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360889.099640:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.099645:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d66103ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360889.101226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360889.101720:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130351744 00000100:00100000:2.0:1788360889.101731:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130351744 00000100:00100000:2.0:1788360889.101789:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788360889.102553:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:9641:x1875232130351744:12345-192.168.203.60@tcp:101:touch.500 00010000:00010000:2.0:1788360889.102577:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360889.102599:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66103f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1c0 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.102703:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66103f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1c0 expref: 10 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.102718:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66103f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1c0 expref: 10 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.102736:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:2.0:1788360889.102739:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788360889.102742:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:2.0:1788360889.102815:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:9641:x1875232130351744:12345-192.168.203.60@tcp:101:touch.500 Request processed in 270us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360889.102822:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788360889.106441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360889.106569:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130351872 00000100:00100000:0.0:1788360889.106579:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130351872 00000100:00100000:0.0:1788360889.106629:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788360889.106645:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875232130351872:12345-192.168.203.60@tcp:8:touch.500 00010000:00080000:0.0:1788360889.106678:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:0.0:1788360889.106707:0:6592:0:(genops.c:1406:class_connect()) connect: client 11e5d128-044a-45c3-b501-2dba6e5a82fa, cookie 0xf6a94c97d66103fa 00002000:00100000:0.0:1788360889.106717:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11e5d128-044a-45c3-b501-2dba6e5a82fa/ffff9a8a83e4e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788360889.106739:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788360889.106958:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788360889.106983:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a8abc489000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788360889.107045:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2348:x1875232130351872:12345-192.168.203.60@tcp:8:touch.500 Request processed in 408us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360889.107051:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1788360889.109933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360889.110000:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130352000 00000100:00100000:3.0:1788360889.110009:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130352000 00000100:00100000:3.0:1788360889.110143:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788360889.110157:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:0:x1875232130352000:12345-192.168.203.60@tcp:2:touch.500 00000100:00080000:1.0:1788360889.110658:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788360889.160835:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000001:00080000:0.0:1788360889.160856:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788360889.161015:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:0:x1875232130352000:12345-192.168.203.60@tcp:2:touch.500 Request processed in 50858us (51084us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788360889.161026:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788360889.168792:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360889.168893:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130352256 00000100:00100000:2.0:1788360889.168903:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130352256 00000100:00100000:2.0:1788360889.168960:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1788360889.168969:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:9641:x1875232130352256:12345-192.168.203.60@tcp:35:touch.500 00000100:00100000:2.0:1788360889.169535:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:9641:x1875232130352256:12345-192.168.203.60@tcp:35:touch.500 Request processed in 564us (750us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788360889.169542:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1788360889.183926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360889.184053:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130352384 00000100:00100000:1.0:1788360889.184063:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130352384 00000100:00100000:3.0:1788360889.184617:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788360889.184646:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:9642:x1875232130352384:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:3.0:1788360889.184669:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360889.184689:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6610401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.184755:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610408 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.184768:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.184779:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360889.184838:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788360889.184843:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788360889.184876:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.184896:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6610401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1c7 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.184909:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1c7 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.184914:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99640e00) 00010000:00010000:3.0:1788360889.184916:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788360889.184919:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f600, rc 0) 00000100:00100000:3.0:1788360889.184968:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:9642:x1875232130352384:12345-192.168.203.60@tcp:101:rm.0 Request processed in 326us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360889.184984:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788360889.189863:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360889.189959:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130352640 00000100:00100000:0.0:1788360889.189969:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130352640 00000100:00100000:0.0:1788360889.190029:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788360889.190039:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:9642:x1875232130352640:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1788360889.190078:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360889.190140:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d661040f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1ce expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360889.190273:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788360889.190777:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d661040f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ce expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.190792:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1e00) 00010000:00010000:0.0:1788360889.190796:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788360889.190801:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d661040f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ce expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.190816:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80031800, rc 0) 00000100:00100000:0.0:1788360889.190880:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:9642:x1875232130352640:12345-192.168.203.60@tcp:101:rm.0 Request processed in 843us (1027us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788360889.190888:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788360889.196176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360889.196395:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130352768 00000100:00100000:1.0:1788360889.196406:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130352768 00000100:00100000:1.0:1788360889.196469:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1788360889.196479:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:9642:x1875232130352768:12345-192.168.203.60@tcp:37:rm.0 00000100:00100000:1.0:1788360889.202862:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:9642:x1875232130352768:12345-192.168.203.60@tcp:37:rm.0 Request processed in 6374us (6684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360889.202877:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788360889.206829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360889.206917:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130353024 00000100:00100000:2.0:1788360889.206928:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130353024 00000100:00100000:2.0:1788360889.206986:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788360889.206997:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f89c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:9642:x1875232130353024:12345-192.168.203.60@tcp:35:rm.0 00000100:00100000:2.0:1788360889.207610:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f89c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:9642:x1875232130353024:12345-192.168.203.60@tcp:35:rm.0 Request processed in 613us (788us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788360889.207619:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788360889.210508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360889.210612:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130353280 00000100:00100000:0.0:1788360889.210621:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130353280 00000100:00100000:0.0:1788360889.210785:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:0.0:1788360889.210795:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:9642:x1875232130353280:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1788360889.210820:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360889.210838:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d661041d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1d5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.210977:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6610424 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.210993:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6610424 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.211004:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6610424 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360889.211015:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788360889.211178:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d661041d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1d5 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.211281:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6610424 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1d5 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.211291:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99640e00) 00010000:00010000:0.0:1788360889.211294:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788360889.211297:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80031800, rc 0) 00000100:00100000:0.0:1788360889.211351:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:9642:x1875232130353280:12345-192.168.203.60@tcp:101:rm.0 Request processed in 557us (851us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788360889.211359:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1788360889.213974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360889.214061:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130353408 00000100:00100000:2.0:1788360889.214070:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130353408 00000100:00100000:2.0:1788360889.214159:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:2.0:1788360889.214169:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:9642:x1875232130353408:12345-192.168.203.60@tcp:41:rm.0 00000004:00000024:2.0:1788360889.214237:0:6736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788360889.214317:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:9642:x1875232130353408:12345-192.168.203.60@tcp:41:rm.0 Request processed in 149us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360889.214324:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788360889.216304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360889.216362:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130353536 00000100:00100000:3.0:1788360889.216371:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130353536 00000100:00100000:3.0:1788360889.216434:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1788360889.216443:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:9642:x1875232130353536:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:3.0:1788360889.216462:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360889.216484:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6610432 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1dc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216546:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610439 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216560:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216704:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216722:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6610440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216729:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6610440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216735:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6610440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216884:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216903:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216911:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360889.216937:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788360889.216941:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788360889.216957:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216967:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216975:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216981:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610439 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216987:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.216994:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360889.216999:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217007:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610439 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217018:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99640e00) 00010000:00010000:3.0:1788360889.217021:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360889.217031:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610439 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217038:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6610439 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217053:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6610440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217059:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6610440 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217064:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6610440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217069:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360889.217072:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6610440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217077:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6610440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217131:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7e4cf8fb (ffff9a8a99526d00) 00010000:00010000:3.0:1788360889.217133:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360889.217136:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6610440 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217142:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6610440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217175:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6610432 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1dc expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217346:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1dc expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.217354:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788360889.217357:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788360889.217359:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f200, rc 0) 00000100:00100000:0.0:1788360889.217514:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:9642:x1875232130353536:12345-192.168.203.60@tcp:101:rm.0 Request processed in 1067us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360889.217523:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1788360889.220645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360889.220725:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130353792 00000100:00100000:0.0:1788360889.220751:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130353792 00000100:00100000:0.0:1788360889.220810:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:0.0:1788360889.220820:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:9642:x1875232130353792:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:0.0:1788360889.220877:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788360889.220903:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610447 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1dc expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.220926:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66103f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1c0 expref: 16 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.220936:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788360889.220952:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610408 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1c7 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.220960:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99640e00) 00010000:00010000:0.0:1788360889.220963:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788360889.220981:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661044e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.220994:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661044e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.221003:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661044e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.221033:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.221041:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.221059:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.222003:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661045c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.222015:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.222023:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788360889.223779:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788360889.223793:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 279238706887ns, next at 280238703462ns, rc = 0 00010000:00010000:1.0:1788360889.223863:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.223877:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.223888:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.223911:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.223917:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.223923:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224002:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788360889.224029:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224036:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661045c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224042:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661045c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224048:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705aa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360889.224052:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661045c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224059:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661045c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224071:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a8a99640000) 00010000:00010000:1.0:1788360889.224073:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788360889.224078:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661045c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224132:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661045c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224154:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661044e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224160:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661044e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224166:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661044e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224171:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360889.224174:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661044e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224180:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661044e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224199:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99640e00) 00010000:00010000:1.0:1788360889.224201:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360889.224204:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661044e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360889.224210:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661044e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788360889.224222:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f1fc31f reply state 00000000ddadfcf2 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360889.224231:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788360889.224338:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:9642:x1875232130353792:12345-192.168.203.60@tcp:36:rm.0 Request processed in 3516us (3700us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788360889.224347:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00010000:00010000:2.0:1788360889.227063:0:11019:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360889.227076:0:11019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.227113:0:11019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788360889.227126:0:11019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.227136:0:11019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.227155:0:11019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a8a99640000) 00010000:00010000:2.0:1788360889.227158:0:11019:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788360889.227163:0:11019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.227169:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610463 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.227216:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360889.227219:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360889.227220:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360889.228211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1788360889.228517:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.228528:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.228535:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.228542:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360889.228546:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.228554:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.228569:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7e4cf8fb (ffff9a8a983bfe00) 00010000:00010000:0.0:1788360889.228571:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360889.228575:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360889.228581:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610455 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7e4cf8fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360889.228713:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130354048 00000100:00100000:2.0:1788360889.228724:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130354048 00000100:00100000:2.0:1788360889.228781:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788360889.228791:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:9642:x1875232130354048:12345-192.168.203.60@tcp:35:rm.0 00000100:00100000:2.0:1788360889.229081:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:9642:x1875232130354048:12345-192.168.203.60@tcp:35:rm.0 Request processed in 291us (875us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788360889.229108:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788360889.232865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360889.232958:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130354304 00000100:00100000:2.0:1788360889.232969:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130354304 00000100:00100000:2.0:1788360889.233056:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:2.0:1788360889.233067:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:9642:x1875232130354304:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:2.0:1788360889.233164:0:6736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788360889.233545:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6610424 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1d5 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.233575:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ae00/0xf6a94c97d66103c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1b2 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.233586:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8a99640e00) 00010000:00010000:2.0:1788360889.233603:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610383 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1a4 expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.233611:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1e00) 00010000:00010000:2.0:1788360889.233634:0:6736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788360889.233658:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661046a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.233671:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661046a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.233681:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661046a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.233693:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.233701:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.233707:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.234068:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610478 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.234078:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610478 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.234134:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610478 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360889.235141:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788360889.235158:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610478 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235167:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610478 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235181:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610478 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235348:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360889.235354:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610478 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235362:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610478 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235375:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360889.235378:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788360889.235383:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610478 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235458:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610478 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235478:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661046a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235484:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661046a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235490:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661046a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235495:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360889.235498:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661046a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235514:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661046a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235522:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:2.0:1788360889.235524:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360889.235528:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661046a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360889.235534:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661046a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360889.235545:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2076ee7 reply state 000000001de075ba transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360889.235553:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788360889.235675:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:9642:x1875232130354304:12345-192.168.203.60@tcp:36:rm.0 Request processed in 2607us (2820us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788360889.235683:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00010000:00010000:3.0:1788360889.237336:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.237352:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.237359:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.237365:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360889.237369:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.237377:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.237487:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a8aa8ee1000) 00010000:00010000:3.0:1788360889.237491:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360889.237495:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360889.237502:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610471 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360889.504537:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144013184:0@lo:400:kworker.0 00000100:00100000:0.0:1788360889.504590:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144013056:0@lo:400:kworker.0 00000100:00100000:1.0:1788360889.504610:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360889.504629:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360889.504674:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144013696:0@lo:400:kworker.0 00000100:00100000:0.0:1788360889.504674:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144013568:0@lo:400:kworker.0 00000100:00100000:0.0:1788360889.504696:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360889.504698:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360889.504731:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144013312:0@lo:400:kworker.0 00000100:00100000:1.0:1788360889.504735:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144013696 00000100:00100000:1.0:1788360889.504742:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144013696 00000100:00100000:0.0:1788360889.504752:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360889.504768:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788360889.504773:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144013440:0@lo:400:kworker.0 00000100:00100000:0.0:1788360889.504792:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360889.504834:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144013184 00000100:00100000:3.0:1788360889.504838:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144013184 00000100:00100000:3.0:1788360889.504867:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144013568 00000100:00100000:3.0:1788360889.504870:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144013568 00000100:00100000:2.0:1788360889.504872:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144013056 00000100:00100000:2.0:1788360889.504875:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144013056 00000100:00100000:3.0:1788360889.504882:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144013312 00000100:00100000:3.0:1788360889.504884:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144013312 00000100:00100000:3.0:1788360889.504899:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788360889.504899:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788360889.504907:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144013184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360889.504907:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144013056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360889.504988:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144013184:12345-0@lo:400:kworker.0 Request processed in 82us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360889.504995:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788360889.505012:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788360889.505017:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144013568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360889.505049:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144013568:12345-0@lo:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360889.505053:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788360889.505064:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788360889.505069:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144013312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360889.505130:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144013312:12345-0@lo:400:kworker.0 Request processed in 49us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360889.505135:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788360889.505159:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788360889.505167:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144013824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360889.505194:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360889.510747:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144013312:0@lo:400:kworker.0 00000100:00100000:0.0:1788360889.510830:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144013824 00000100:00100000:0.0:1788360889.510839:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144013824 00000100:00100000:0.0:1788360889.510901:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788360889.510911:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144013824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788360889.510961:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360889.511032:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144013824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (5836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360889.511038:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788360889.511129:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144013056:12345-0@lo:400:kworker.0 Request processed in 6212us (6488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360889.511137:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788360889.511327:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144013440 00000100:00100000:1.0:1788360889.511332:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144013440 00000100:00100000:0.0:1788360889.511411:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788360889.511422:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144013696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360889.511460:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144013696:12345-0@lo:400:kworker.0 Request processed in 41us (6760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360889.511467:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788360889.511502:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab6da7b80 x1875232144013824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360889.511519:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144013824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360889.511546:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144013056:0@lo:400:kworker.0 00000100:00100000:0.0:1788360889.511571:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144013568:0@lo:400:kworker.0 00000100:00100000:0.0:1788360889.511617:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144013184:0@lo:400:kworker.0 00010000:00080000:0.0:1788360889.511628:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a89865b9180 x1875232144013696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360889.511637:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144013696:0@lo:400:kworker.0 00000100:00080000:2.0:1788360889.511744:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788360889.511749:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788360889.511751:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788360889.512770:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788360889.512779:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144013440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360889.512860:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144013440:12345-0@lo:400:kworker.0 Request processed in 82us (8067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360889.512867:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788360889.513745:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a89865b8000 x1875232144013440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360889.513773:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144013440:0@lo:400:kworker.0 00000100:00100000:3.0:1788360890.017927:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788360890.017952:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144013952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788360890.018024:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360890.024799:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144013952 00000100:00100000:2.0:1788360890.024814:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144013952 00000100:00100000:2.0:1788360890.024884:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788360890.024895:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144013952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788360890.024922:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788360890.025034:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144013952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (7008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360890.025041:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788360890.025305:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab6da5f80 x1875232144013952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360890.025340:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144013952:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788360890.084804:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360891.019229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360891.019299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360891.019872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360891.019890:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130354688 00000100:00100000:2.0:1788360891.019894:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130354432 00000100:00100000:3.0:1788360891.019901:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130354688 00000100:00100000:2.0:1788360891.019902:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130354432 00000100:00100000:0.0:1788360891.019908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360891.019936:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130354560 00000100:00100000:0.0:1788360891.019940:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130354560 00000100:00100000:2.0:1788360891.019958:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:3.0:1788360891.019966:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1788360891.019972:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130354432:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360891.019981:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130354688:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360891.019986:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130354816 00000100:00100000:0.0:1788360891.019991:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130354816 00000100:00100000:0.0:1788360891.020031:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1788360891.020041:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:2349:x1875232130354560:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360891.020052:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130354688:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 73us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360891.020052:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130354432:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 81us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360891.020072:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1788360891.020073:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:0.0:1788360891.020082:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:2349:x1875232130354560:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 43us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360891.020133:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00080000:2.0:1788360891.020154:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360891.020155:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00080000:2.0:1788360891.020161:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788360891.020167:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130354816:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360891.020195:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130354816:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360891.020200:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00010000:00010000:3.0:1788360891.105949:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360892.128382:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788360892.275830:0:11464:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000020:00000080:3.0:1788360893.055942:0:11512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc4973480 20000000:00000080:3.0:1788360893.055959:0:11512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8a8287e800 uarg=0000000000000000 20000000:01000000:3.0:1788360893.055994:0:11512:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788360893.056001:0:11512:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788360893.056006:0:11512:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788360893.057841:0:11513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788360893.058421:0:11512:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788360893.063048:0:11512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788360893.063143:0:11512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788360893.063203:0:11512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788360893.063219:0:11512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788360893.063238:0:11512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.063267:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d6610328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610321 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.063281:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6610336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661032f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.063287:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d6610344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661033d expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.063296:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d661034b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e18f expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.063302:0:11512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d6610352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e196 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.063308:0:11512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.063344:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d6610352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e196 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.063357:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d6610352 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e196 expref: 12 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360893.063371:0:11512:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1875232144014080:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360893.064330:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d661034b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e18f expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.064343:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d661034b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e18f expref: 12 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360893.064355:0:11512:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1875232144014208:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360893.064412:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d6610344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661033d expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.064422:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d6610344 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661033d expref: 18 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360893.064432:0:11512:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1875232144014336:0@lo:104: 00000100:00100000:2.0:1788360893.064469:0:11512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788360893.064507:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6610336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661032f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.064516:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6610336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661032f expref: 18 pid: 5789 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360893.064525:0:11512:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1875232144014464:0@lo:104: 00000100:00100000:2.0:1788360893.064545:0:11512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788360893.064565:0:11512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d6610328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6610321 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.064574:0:11512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d6610328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6610321 expref: 18 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360893.064581:0:11512:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1875232144014592:0@lo:104: 00000100:00100000:2.0:1788360893.064605:0:11512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360893.064618:0:11512:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360893.066801:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788360893.066823:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144014336 00000100:00100000:0.0:1788360893.066831:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144014336 00000100:00100000:0.0:1788360893.066870:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144014464 00000100:00100000:0.0:1788360893.066874:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144014464 00000100:00100000:0.0:1788360893.066886:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144014592 00000100:00100000:0.0:1788360893.066888:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144014592 00000100:00100000:0.0:1788360893.066902:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788360893.066910:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:11512:x1875232144014336:12345-0@lo:104: 00010000:00010000:0.0:1788360893.066928:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067011:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788360893.067017:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+5:11512:x1875232144014336:12345-0@lo:104: Request processed in 108us (2548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360893.067024:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788360893.067043:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788360893.067049:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:11512:x1875232144014464:12345-0@lo:104: 00010000:00010000:0.0:1788360893.067057:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067126:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788360893.067132:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+4:11512:x1875232144014464:12345-0@lo:104: Request processed in 84us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360893.067138:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788360893.067151:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788360893.067157:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abfe75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:11512:x1875232144014592:12345-0@lo:104: 00010000:00010000:0.0:1788360893.067165:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067214:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788360893.067220:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abfe75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+3:11512:x1875232144014592:12345-0@lo:104: Request processed in 64us (2615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360893.067225:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788360893.067263:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788360893.067269:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067275:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788360893.067279:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067287:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788360893.067293:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360893.067298:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788360893.067330:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067336:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788360893.067355:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067369:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a200/0xf6a94c97d661033d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610344 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067392:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788360893.067395:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067400:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788360893.067403:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067409:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788360893.067415:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360893.067419:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788360893.067432:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067436:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788360893.067442:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067447:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b200/0xf6a94c97d661032f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610336 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067455:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788360893.067458:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067472:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788360893.067475:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067480:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788360893.067487:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360893.067492:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788360893.067505:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067511:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788360893.067525:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067531:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b400/0xf6a94c97d6610321 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6610328 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067545:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360893.067547:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360893.067548:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360893.067554:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360893.067566:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144014720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788360893.067599:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360893.067632:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360893.067638:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144014848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788360893.067667:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360893.067695:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144014976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788360893.067721:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360893.067756:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144014720 00000100:00100000:0.0:1788360893.067761:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144014720 00010000:00010000:0.0:1788360893.067782:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d6610344 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661033d expref: 19 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360893.067802:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144014848 00000100:00100000:0.0:1788360893.067805:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144014848 00010000:00010000:0.0:1788360893.067815:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6610336 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661032f expref: 20 pid: 5789 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360893.067829:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144014976 00000100:00100000:0.0:1788360893.067832:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144014976 00010000:00010000:0.0:1788360893.067841:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d6610328 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610321 expref: 21 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360893.067853:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788360893.067858:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+21:3313:x1875232144014720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788360893.067867:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360893.067872:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d6610344 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661033d expref: 21 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067880:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d6610344 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661033d expref: 21 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067896:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360893.067922:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+21:3313:x1875232144014720:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360893.067938:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788360893.067952:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788360893.067958:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+20:3313:x1875232144014848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788360893.067965:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360893.067969:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6610336 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661032f expref: 20 pid: 5789 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067977:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6610336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661032f expref: 20 pid: 5789 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.067986:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360893.068008:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+20:3313:x1875232144014848:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360893.068014:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788360893.068025:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788360893.068031:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84edb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144014976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788360893.068038:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360893.068041:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d6610328 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6610321 expref: 19 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.068048:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d6610328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6610321 expref: 19 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.068056:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360893.068077:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84edb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144014976:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360893.068082:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788360893.068175:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144014976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788360893.068208:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144014848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788360893.068215:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144014720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788360893.068257:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360893.071503:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d6610344 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661033d expref: 18 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360893.071523:0:11512:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1875232144014336:0@lo:104: 00010000:00010000:2.0:1788360893.071534:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6610336 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661032f expref: 17 pid: 5789 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360893.071559:0:11512:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1875232144014464:0@lo:104: 00010000:00010000:2.0:1788360893.071571:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d6610328 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6610321 expref: 16 pid: 5792 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360893.071578:0:11512:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1875232144014592:0@lo:104: 00000100:00100000:0.0:1788360893.074006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360893.074045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360893.074075:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130354944 00000100:00100000:0.0:1788360893.074114:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130354944 00010000:00010000:0.0:1788360893.074151:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d6610352 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e196 expref: 13 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360893.074181:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130355072 00000100:00100000:0.0:1788360893.074184:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130355072 00010000:00010000:0.0:1788360893.074195:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d661034b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e18f expref: 14 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360893.074312:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:3.0:1788360893.074328:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee34693-2e5d-4e3f-a247-33b45ac274f5+14:2349:x1875232130354944:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360893.074345:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360893.074350:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d6610352 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e196 expref: 14 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074361:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d6610352 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e196 expref: 14 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074396:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360893.074447:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee34693-2e5d-4e3f-a247-33b45ac274f5+14:2349:x1875232130354944:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 123us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360893.074454:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:3.0:1788360893.074473:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1788360893.074479:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2350:x1875232130355072:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360893.074486:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360893.074491:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d661034b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e18f expref: 13 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074500:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d661034b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e18f expref: 13 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074512:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074519:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074540:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074547:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074554:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074560:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074573:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788360893.074577:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074585:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074595:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360893.074604:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360893.074625:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2350:x1875232130355072:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 146us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360893.074630:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00010000:00010000:2.0:1788360893.075387:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d6610352 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e196 expref: 12 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360893.075403:0:11512:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1875232144014080:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360893.075412:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d661034b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e18f expref: 11 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360893.075420:0:11512:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11512:1875232144014208:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360893.075445:0:11512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.075453:0:11512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.075464:0:11512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360893.075471:0:11512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d661047f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360893.163307:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788360894.152502:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:3.0:1788360894.152601:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1788360894.152607:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788360894.152873:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788360894.152893:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144015104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788360894.152959:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360894.153263:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144015104 00000100:00100000:2.0:1788360894.153272:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144015104 00000100:00100000:2.0:1788360894.153322:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788360894.153345:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144015104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788360894.153444:0:6594:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788360894.153475:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9838b9, atime: 0x6a9838b9, ctime: 0x6a9838b9, blocks: 0x1 00010000:00010000:2.0:1788360894.153484:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610486 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360894.153500:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=284s v=(0 0) 00010000:00010000:2.0:1788360894.153505:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360894.153511:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360894.153526:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360894.153535:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360894.153542:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360894.153557:0:6594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1788360894.154254:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788360894.154329:0:11019:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788360894.154338:0:11019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360894.154348:0:11019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788360894.154605:0:11019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360894.154616:0:11019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360894.154637:0:11019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610486 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360894.154653:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610486 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360894.154940:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360894.154943:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360894.154945:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360894.155231:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144015104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1885us (2268us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788360894.155241:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000001:00080000:3.0:1788360894.155623:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788360894.155766:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ab6da5f80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788360894.155774:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144015104:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788360894.176348:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360894.624434:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144015488:0@lo:400:kworker.0 00000100:00100000:2.0:1788360894.624508:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360894.624593:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788360894.624600:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144015616:0@lo:400:kworker.0 00000100:00100000:2.0:1788360894.624625:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360894.624701:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144015360:0@lo:400:kworker.0 00000100:00100000:1.0:1788360894.624727:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360894.624753:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788360894.624759:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144015232:0@lo:400:kworker.0 00000100:00100000:1.0:1788360894.624785:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360894.624817:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144015744:0@lo:400:kworker.0 00000100:00100000:1.0:1788360894.624837:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360894.624864:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144015232 00000100:00100000:1.0:1788360894.624878:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144015232 00000100:00100000:1.0:1788360894.624922:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788360894.624931:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:3314:x1875232144015232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360894.624981:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:3314:x1875232144015232:12345-0@lo:400:kworker.0 Request processed in 51us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360894.624988:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788360894.625035:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144015232:0@lo:400:kworker.0 00000100:00100000:2.0:1788360894.625206:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144015488 00000100:00100000:2.0:1788360894.625211:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144015488 00000100:00100000:2.0:1788360894.625251:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144015360 00000100:00100000:2.0:1788360894.625254:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144015360 00000100:00100000:1.0:1788360894.625264:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144015744 00000100:00100000:1.0:1788360894.625270:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144015744 00000100:00100000:2.0:1788360894.625274:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788360894.625286:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144015488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360894.625305:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788360894.625315:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144015360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360894.625331:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144015488:12345-0@lo:400:kworker.0 Request processed in 49us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360894.625338:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788360894.625355:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788360894.625364:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144015744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360894.625369:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144015360:12345-0@lo:400:kworker.0 Request processed in 54us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360894.625378:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788360894.625401:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144015744:12345-0@lo:400:kworker.0 Request processed in 38us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360894.625408:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788360894.625416:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144015744:0@lo:400:kworker.0 00000100:00100000:1.0:1788360894.625429:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144015360:0@lo:400:kworker.0 00000100:00100000:2.0:1788360894.625445:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144015488:0@lo:400:kworker.0 00000100:00100000:3.0:1788360894.625526:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144015616 00000100:00100000:3.0:1788360894.625531:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144015616 00000100:00100000:3.0:1788360894.625578:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788360894.625586:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144015616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360894.625637:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144015616:12345-0@lo:400:kworker.0 Request processed in 52us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360894.625644:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788360894.625663:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788360894.625667:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788360894.625687:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a89865bad80 x1875232144015616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360894.625699:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144015616:0@lo:400:kworker.0 00000100:00100000:1.0:1788360894.626117:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144015872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788360894.626211:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360894.626345:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144015872 00000100:00100000:0.0:1788360894.626350:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144015872 00000100:00100000:0.0:1788360894.626380:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788360894.626388:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144015872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788360894.626417:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360894.626552:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144015872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360894.626559:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788360894.626850:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab6da4e00 x1875232144015872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360894.626864:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144015872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360895.047812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360895.047888:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130355200 00000100:00100000:2.0:1788360895.047897:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130355200 00000100:00100000:2.0:1788360895.047948:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:2.0:1788360895.047957:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:5562:x1875232130355200:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360895.047973:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360895.047990:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d661048d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1e3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.048026:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d661048d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1e3 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.048051:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d661048d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1e3 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.048062:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ea00, rc 0) 00000100:00100000:2.0:1788360895.048159:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130355200:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 202us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360895.048174:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:0.0:1788360895.052530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360895.052595:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130355328 00000100:00100000:1.0:1788360895.052607:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130355328 00000100:00100000:1.0:1788360895.052719:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 240 00000100:00100000:1.0:1788360895.052741:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130355328:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360895.053200:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130355328:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 471us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360895.053210:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 240 00000100:00100000:0.0:1788360895.055265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360895.055357:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130355456 00000100:00100000:2.0:1788360895.055367:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130355456 00000100:00100000:2.0:1788360895.055424:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 241 00000100:00100000:2.0:1788360895.055433:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130355456:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788360895.055653:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130355456:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 220us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360895.055661:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 241 00000100:00100000:0.0:1788360895.061800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360895.062959:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130355584 00000100:00100000:1.0:1788360895.062969:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130355584 00000100:00100000:1.0:1788360895.063042:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 242 00000100:00100000:1.0:1788360895.063052:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:9912:x1875232130355584:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788360895.063336:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:9912:x1875232130355584:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 284us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360895.063344:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 242 00000100:00100000:0.0:1788360895.069319:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360895.069464:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130355712 00000100:00100000:1.0:1788360895.069475:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130355712 00000100:00100000:1.0:1788360895.069540:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 243 00000100:00100000:1.0:1788360895.069550:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:9912:x1875232130355712:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788360895.069982:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:9912:x1875232130355712:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 431us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360895.069991:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 243 10000000:01000000:1.0:1788360895.082333:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788360895.082340:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a898534c800 from 7 10000000:01000000:1.0:1788360895.082345:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788360895.082443:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360895.082455:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360895.082466:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360895.082503:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788360895.082565:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360895.082688:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360895.085157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360895.087872:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144016000 00000100:00100000:2.0:1788360895.087889:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144016000 00000100:00100000:2.0:1788360895.087951:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130355840 00000100:00100000:2.0:1788360895.087954:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130355840 00000100:00100000:2.0:1788360895.087973:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788360895.087983:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:5794:x1875232144016000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360895.088002:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360895.088020:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d661049b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6610494 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.088060:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d661049b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6610494 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.088123:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d661049b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6610494 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.088131:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e200, rc 0) 00000100:00100000:2.0:1788360895.088211:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144016000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (5645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360895.088218:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788360895.088250:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 245 00000100:00100000:2.0:1788360895.088258:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:5562:x1875232130355840:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360895.088277:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360895.088287:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d66104a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1ea expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.088301:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d66104a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ea expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.088310:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d66104a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ea expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.088317:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:2.0:1788360895.088374:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:5562:x1875232130355840:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 115us (3223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360895.088381:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 245 00000100:00100000:0.0:1788360895.088979:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788360895.088997:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360895.089006:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360895.089132:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360895.089171:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360895.089197:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788360895.089477:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144016128 00000100:00100000:1.0:1788360895.089483:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144016128 00000100:00100000:1.0:1788360895.089524:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788360895.089532:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144016128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788360895.089919:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144016128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 387us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360895.089927:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788360895.090011:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360895.090054:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360895.090133:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360895.090160:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788360895.090536:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144016256 00000100:00100000:3.0:1788360895.090542:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144016256 00000100:00100000:3.0:1788360895.090571:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788360895.090577:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144016256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788360895.090752:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144016256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360895.090760:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788360895.091695:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360895.092168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360895.092193:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130355968 00000100:00100000:0.0:1788360895.092198:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130355968 00000100:00100000:0.0:1788360895.092231:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 248 00000100:00100000:0.0:1788360895.092238:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:5562:x1875232130355968:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360895.092490:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:5562:x1875232130355968:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 251us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360895.092498:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 248 00000100:00100000:2.0:1788360895.097113:0:11529:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11529:1875232144016384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788360895.097204:0:11529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360895.097247:0:11529:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360895.097392:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144016384 00000100:00100000:0.0:1788360895.097400:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144016384 00000100:00100000:0.0:1788360895.097451:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788360895.097461:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:11529:x1875232144016384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360895.097708:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:11529:x1875232144016384:12345-0@lo:502:llog_process_th.0 Request processed in 247us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360895.097716:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788360895.097940:0:11529:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11529:1875232144016384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788360895.097970:0:11529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788360895.097979:0:11529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788360895.097982:0:11529:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788360895.097990:0:11529:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a898534c800 00000020:00000080:3.0:1788360895.097992:0:11529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788360895.098068:0:11529:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11529:1875232144016512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788360895.098137:0:11529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360895.098162:0:11529:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788360895.098257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360895.098411:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144016512 00000100:00100000:2.0:1788360895.098416:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144016512 00000100:00100000:2.0:1788360895.098436:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130356096 00000100:00100000:2.0:1788360895.098439:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130356096 00000100:00100000:2.0:1788360895.098452:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788360895.098459:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a867e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:11529:x1875232144016512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788360895.098620:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a867e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:11529:x1875232144016512:12345-0@lo:502:llog_process_th.0 Request processed in 161us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360895.098627:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788360895.098653:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 251 00000100:00100000:2.0:1788360895.098660:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a867e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:5562:x1875232130356096:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788360895.098875:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a867e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:5562:x1875232130356096:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 214us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360895.098882:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 251 00000100:00100000:1.0:1788360895.100117:0:11529:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11529:1875232144016512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788360895.100161:0:11529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788360895.100168:0:11529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360895.100171:0:11529:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788360895.100175:0:11529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788360895.101177:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788360895.101203:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788360895.101224:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360895.101236:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360895.101247:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788360895.101249:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a86b49000 from 7 10000000:01000000:3.0:1788360895.101252:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788360895.101292:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360895.101301:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360895.101310:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360895.101332:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788360895.101398:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360895.101429:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788360895.101500:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144016640 00000100:00100000:2.0:1788360895.101507:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144016640 00000100:00100000:2.0:1788360895.101550:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788360895.101558:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:5794:x1875232144016640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360895.101570:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360895.101582:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f200/0xf6a94c97d66104b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66104a9 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.102834:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f200/0xf6a94c97d66104b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66104a9 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.102851:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573f200/0xf6a94c97d66104b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66104a9 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.102872:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f200, rc 0) 00000100:00100000:2.0:1788360895.102941:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144016640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1382us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360895.102948:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788360895.103461:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788360895.103479:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360895.103489:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360895.103564:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360895.103598:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360895.103631:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565900 going to sleep for 11 seconds 00000100:00100000:3.0:1788360895.103702:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144016768 00000100:00100000:3.0:1788360895.103709:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144016768 00000100:00100000:3.0:1788360895.103858:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788360895.103867:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144016768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788360895.104166:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144016768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360895.104174:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788360895.104983:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788360895.105026:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788360895.105071:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360895.105132:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565900 going to sleep for 11 seconds 00000100:00100000:1.0:1788360895.106016:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144016896 00000100:00100000:1.0:1788360895.106025:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144016896 00000100:00100000:1.0:1788360895.106069:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788360895.106077:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144016896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360895.106296:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144016896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360895.106304:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788360895.106356:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144016896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788360895.106522:0:11531:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbc1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11531:1875232144017024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360895.106566:0:11531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360895.106592:0:11531:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788360895.106615:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144017024 00000100:00100000:1.0:1788360895.106619:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144017024 00000100:00100000:1.0:1788360895.106641:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788360895.106648:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:11531:x1875232144017024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360895.106789:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8575ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:11531:x1875232144017024:12345-0@lo:502:llog_process_th.0 Request processed in 141us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360895.106797:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788360895.106829:0:11531:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbc1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11531:1875232144017024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788360895.106845:0:11531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788360895.106851:0:11531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360895.106853:0:11531:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788360895.106858:0:11531:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8a86b49000 00000020:00000080:1.0:1788360895.106859:0:11531:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788360895.107504:0:11531:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbc1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11531:1875232144017152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360895.107544:0:11531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360895.107569:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144017152 00000100:00100000:1.0:1788360895.107573:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144017152 00000100:00100000:1.0:1788360895.107601:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788360895.107607:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:11531:x1875232144017152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788360895.107744:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:11531:x1875232144017152:12345-0@lo:502:llog_process_th.0 Request processed in 137us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360895.107752:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788360895.107787:0:11531:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788360895.107802:0:11531:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbc1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11531:1875232144017152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788360895.107830:0:11531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788360895.107835:0:11531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788360895.107837:0:11531:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788360895.107841:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788360895.111315:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 00000100:00100000:2.0:1788360895.111330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 10000000:01000000:3.0:1788360895.111356:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788360895.111368:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360895.111384:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360895.111395:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788360895.111397:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a83778000 from 7 10000000:01000000:3.0:1788360895.111399:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788360895.111434:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360895.111443:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360895.111455:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360895.111476:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144017280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788360895.111807:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130356224 00000100:00100000:2.0:1788360895.111816:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130356224 00000100:00100000:2.0:1788360895.111864:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 257 00000100:00100000:2.0:1788360895.111875:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:9915:x1875232130356224:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788360895.112653:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:9915:x1875232130356224:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 776us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360895.112663:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 257 00000100:00100000:3.0:1788360895.112695:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360895.112746:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788360895.112766:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144017280 00000100:00100000:3.0:1788360895.112771:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144017280 00000100:00100000:3.0:1788360895.112805:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788360895.112814:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:5794:x1875232144017280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788360895.112825:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360895.112840:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d66104be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66104b7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360895.112875:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d66104be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66104b7 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360895.112884:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d66104be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66104b7 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360895.112892:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e200, rc 0) 00000100:00100000:3.0:1788360895.112936:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232144017280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360895.112942:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788360895.113224:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144017280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788360895.113241:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360895.113250:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360895.113318:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144017408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788360895.113361:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360895.113389:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788360895.113952:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144017408 00000100:00100000:3.0:1788360895.113958:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144017408 00000100:00100000:3.0:1788360895.113995:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788360895.114003:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232144017408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788360895.114294:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232144017408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360895.114306:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788360895.114386:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144017408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788360895.114423:0:5794:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144017536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788360895.114470:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360895.114495:0:5794:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788360895.114510:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144017536 00000100:00100000:3.0:1788360895.114516:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144017536 00000100:00100000:3.0:1788360895.114542:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788360895.114548:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232144017536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788360895.114719:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:5794:x1875232144017536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360895.114725:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788360895.114827:0:5794:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d9fa3464-d771-4fa1-895d-6f4c1383568d:5794:1875232144017536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788360895.115341:0:11532:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11532:1875232144017664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788360895.115383:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360895.115444:0:11532:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360895.115527:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144017664 00000100:00100000:0.0:1788360895.115533:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144017664 00000100:00100000:0.0:1788360895.115601:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788360895.115608:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:11532:x1875232144017664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788360895.115790:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:11532:x1875232144017664:12345-0@lo:502:llog_process_th.0 Request processed in 182us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360895.115798:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788360895.115892:0:11532:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11532:1875232144017664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788360895.116008:0:11532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788360895.116104:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788360895.116108:0:11532:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788360895.116119:0:11532:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8a83778000 00000020:00000080:3.0:1788360895.116121:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788360895.116479:0:11532:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11532:1875232144017792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788360895.116536:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360895.116536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360895.116989:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144017792 00000100:00100000:3.0:1788360895.116995:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144017792 00000100:00100000:2.0:1788360895.117004:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130356352 00000100:00100000:2.0:1788360895.117011:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130356352 00000100:00100000:2.0:1788360895.117041:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 262 00000100:00100000:2.0:1788360895.117049:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:9915:x1875232130356352:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788360895.117273:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:9915:x1875232130356352:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 223us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360895.117281:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 262 00000100:00100000:3.0:1788360895.117727:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788360895.117789:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:11532:x1875232144017792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788360895.117942:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:11532:x1875232144017792:12345-0@lo:502:llog_process_th.0 Request processed in 207us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360895.117949:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788360895.117994:0:11532:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788360895.118156:0:11532:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d9fa3464-d771-4fa1-895d-6f4c1383568d:11532:1875232144017792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788360895.118194:0:11532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788360895.118201:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788360895.118204:0:11532:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788360895.118210:0:11532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788360895.118532:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788360895.118551:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788360895.118561:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360895.118579:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788360895.124995:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788360895.140031:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144017920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788360895.140122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360895.140197:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144017920 00000100:00100000:1.0:1788360895.140206:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144017920 00000100:00100000:1.0:1788360895.140253:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788360895.140262:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144017920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788360895.140297:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360895.140484:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144017920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 222us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360895.140491:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788360895.140620:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144017920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788360895.200586:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360896.138233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360896.138637:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130356480 00000100:00100000:3.0:1788360896.138649:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130356480 00000100:00100000:3.0:1788360896.138794:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 264 00000100:00100000:3.0:1788360896.138804:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130356480:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360896.138916:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130356480:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 113us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360896.138924:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 264 00000100:00100000:2.0:1788360896.140197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360896.140231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360896.140265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360896.140355:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130356608 00000100:00100000:1.0:1788360896.140363:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130356608 00000100:00100000:0.0:1788360896.140377:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130356864 00000100:00100000:3.0:1788360896.140523:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130356736 00000100:00100000:3.0:1788360896.140528:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130356736 00000100:00100000:0.0:1788360896.141179:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130356864 00000100:00100000:1.0:1788360896.141199:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1788360896.141210:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130356608:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360896.141266:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130356608:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 61us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360896.141273:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00080000:2.0:1788360896.143061:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788360896.143080:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360896.143144:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:0.0:1788360896.143156:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130356864:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360896.143230:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130356864:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 77us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360896.143239:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788360896.144271:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1788360896.144291:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130356736:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360896.144431:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130356736:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 147us (4164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360896.145104:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000040:00080000:3.0:1788360896.160857:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788360896.225053:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360897.248238:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360898.274825:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788360899.292611:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1788360899.296311:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360899.744287:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232144018048:0@lo:400:kworker.0 00000100:00100000:0.0:1788360899.744371:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360899.744464:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144018048 00000100:00100000:1.0:1788360899.744472:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144018048 00000100:00100000:1.0:1788360899.744520:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788360899.744532:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232144018048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360899.744562:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144018432:0@lo:400:kworker.0 00000100:00100000:0.0:1788360899.744590:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144018304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788360899.744596:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232144018048:12345-0@lo:400:kworker.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360899.744607:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360899.744620:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788360899.744644:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360899.744649:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144018432 00000100:00100000:2.0:1788360899.744654:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144018432 00000100:00100000:0.0:1788360899.744670:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788360899.744678:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144018176:0@lo:400:kworker.0 00000100:00100000:2.0:1788360899.744698:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788360899.744706:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360899.744711:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144018432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360899.744737:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144018176 00000100:00100000:0.0:1788360899.744742:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144018176 00000100:00100000:2.0:1788360899.744760:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144018432:12345-0@lo:400:kworker.0 Request processed in 53us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360899.744767:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788360899.744784:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788360899.744791:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144018176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360899.744823:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232144018048:0@lo:400:kworker.0 00000100:00100000:2.0:1788360899.744842:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144018176:12345-0@lo:400:kworker.0 Request processed in 49us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360899.744851:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788360899.744873:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144018304 00000100:00080000:2.0:1788360899.744874:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360899.744879:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144018304 00000100:00100000:2.0:1788360899.744905:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144018432:0@lo:400:kworker.0 00000100:00100000:0.0:1788360899.744924:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788360899.744933:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144018304:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788360899.744937:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788360899.744963:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360899.744967:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144018176:0@lo:400:kworker.0 00000100:00100000:0.0:1788360899.745010:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144018304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360899.745017:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788360899.745021:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ab6da5c00 x1875232144018304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360899.745038:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144018304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360899.745062:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144018560:0@lo:400:kworker.0 00000100:00100000:2.0:1788360899.745177:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144018688:0@lo:400:kworker.0 00000100:00100000:2.0:1788360899.746478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360899.746520:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360899.746666:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144018688 00000100:00100000:0.0:1788360899.747078:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144018688 00000100:00100000:1.0:1788360899.747142:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144018560 00000100:00100000:1.0:1788360899.747147:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144018560 00000100:00100000:1.0:1788360899.747278:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788360899.747287:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144018560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360899.747337:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144018560:12345-0@lo:400:kworker.0 Request processed in 52us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360899.747343:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788360899.748000:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360899.748154:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788360899.748165:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144018688:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788360899.748214:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788360899.748262:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144018560:0@lo:400:kworker.0 00000100:00100000:0.0:1788360899.748375:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144018688:12345-0@lo:400:kworker.0 Request processed in 213us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360899.748383:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788360899.748430:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788360899.748436:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ab6da5f80, transno 4294967300 00000100:00100000:2.0:1788360899.748454:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144018688:0@lo:400:kworker.0 00000100:00100000:3.0:1788360900.256333:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788360900.256917:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144018816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788360900.256991:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360900.258007:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144018816 00000100:00100000:1.0:1788360900.258017:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144018816 00000100:00100000:1.0:1788360900.258605:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788360900.258618:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144018816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788360900.258659:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360900.258738:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144018816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360900.258745:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788360900.258892:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144018816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788360900.323280:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360901.256385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360901.256623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360901.256661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360901.256703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360901.256781:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130357120 00000100:00100000:3.0:1788360901.256791:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130357120 00000100:00100000:3.0:1788360901.256874:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130357376 00000100:00100000:3.0:1788360901.256878:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130357376 00000100:00100000:3.0:1788360901.256904:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788360901.256914:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130357120:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360901.256992:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130357120:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 79us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360901.256998:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788360901.257015:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:3.0:1788360901.257021:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130357376:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360901.257055:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130357376:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360901.257061:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00080000:1.0:1788360901.257762:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360901.259195:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130356992 00000100:00100000:0.0:1788360901.259207:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130356992 00000100:00100000:0.0:1788360901.259272:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 266 00000100:00100000:0.0:1788360901.259282:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2350:x1875232130356992:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360901.259370:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2350:x1875232130356992:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 90us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360901.259378:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 266 00000100:00100000:0.0:1788360901.259437:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130357248 00000100:00100000:0.0:1788360901.259442:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130357248 00000100:00100000:0.0:1788360901.259495:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:0.0:1788360901.259501:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130357248:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360901.259542:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130357248:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 41us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360901.259548:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00080000:3.0:1788360901.259870:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788360901.348564:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360902.368331:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360903.392416:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360904.418413:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360904.864267:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788360904.865169:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232144019072:0@lo:400:kworker.0 00000100:00100000:1.0:1788360904.865245:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360904.865478:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144018944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360904.865491:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144019200:0@lo:400:kworker.0 00000100:00100000:1.0:1788360904.865507:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360904.865538:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360904.865547:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144018944 00000100:00100000:1.0:1788360904.865555:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144018944 00000100:00100000:3.0:1788360904.865621:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788360904.865629:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144019328:0@lo:400:kworker.0 00000100:00100000:2.0:1788360904.865650:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144019072 00000100:00100000:2.0:1788360904.865655:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144019072 00000100:00100000:3.0:1788360904.865659:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360904.865690:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788360904.865698:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232144019072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360904.865699:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144019200 00000100:00100000:3.0:1788360904.865706:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144019200 00000100:00100000:3.0:1788360904.865741:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144019328 00000100:00100000:3.0:1788360904.865745:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144019328 00000100:00100000:2.0:1788360904.865757:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3312:x1875232144019072:12345-0@lo:400:kworker.0 Request processed in 56us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360904.865766:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788360904.865773:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788360904.865782:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144019200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360904.865817:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788360904.865827:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144019328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360904.865832:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144019200:12345-0@lo:400:kworker.0 Request processed in 49us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360904.865857:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788360904.865865:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144019328:12345-0@lo:400:kworker.0 Request processed in 39us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360904.865873:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788360904.865908:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144019328:0@lo:400:kworker.0 00000100:00100000:3.0:1788360904.865922:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144019200:0@lo:400:kworker.0 00000100:00100000:1.0:1788360904.865941:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788360904.865952:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144018944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788360904.865978:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360904.866008:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144018944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360904.866306:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144019456:0@lo:400:kworker.0 00000100:00100000:0.0:1788360904.866337:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360904.866357:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788360904.866363:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144019584:0@lo:400:kworker.0 00000100:00100000:0.0:1788360904.866387:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360904.866444:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144019456 00000100:00100000:0.0:1788360904.866448:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144019456 00000100:00100000:0.0:1788360904.866476:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788360904.866483:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144019456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360904.866516:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144019456:12345-0@lo:400:kworker.0 Request processed in 34us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360904.866522:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788360904.866550:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144019456:0@lo:400:kworker.0 00000100:00100000:0.0:1788360904.866578:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144019584 00000100:00100000:0.0:1788360904.866581:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144019584 00000100:00100000:0.0:1788360904.866609:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788360904.866615:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144019584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360904.866649:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144019584:12345-0@lo:400:kworker.0 Request processed in 34us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360904.866654:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788360904.866691:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144019584:0@lo:400:kworker.0 00000100:00100000:0.0:1788360904.866712:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d9fa3464-d771-4fa1-895d-6f4c1383568d:3312:1875232144019072:0@lo:400:kworker.0 00010000:00080000:0.0:1788360904.866724:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abcbc2680 x1875232144018944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360904.866739:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144018944:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788360904.866764:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788360904.866769:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788360904.866771:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788360904.870470:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788360905.376522:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144019712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788360905.376605:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360905.376726:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144019712 00000100:00100000:1.0:1788360905.376736:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144019712 00000100:00100000:1.0:1788360905.376796:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788360905.376806:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144019712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788360905.376842:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360905.381235:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144019712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4420us (4618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360905.381251:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788360905.384171:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144019712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788360905.440765:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360906.375657:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360906.375699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360906.375736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360906.375773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360906.375853:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130357504 00000100:00100000:0.0:1788360906.375863:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130357504 00000100:00100000:0.0:1788360906.375919:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 268 00000100:00100000:0.0:1788360906.375929:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130357504:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360906.376011:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130357504:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360906.376018:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 268 00000100:00100000:0.0:1788360906.376052:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130357760 00000100:00100000:0.0:1788360906.376056:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130357760 00000100:00100000:0.0:1788360906.376130:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1788360906.376137:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130357760:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360906.376167:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130357760:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 30us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360906.376173:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00080000:0.0:1788360906.376304:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788360906.376638:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130357632 00000100:00100000:2.0:1788360906.376644:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130357632 00000100:00100000:2.0:1788360906.376688:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130357888 00000100:00100000:2.0:1788360906.376692:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130357888 00000100:00100000:2.0:1788360906.376718:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788360906.376727:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130357632:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360906.376769:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130357632:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 44us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360906.376775:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788360906.376789:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:2.0:1788360906.376794:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130357888:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360906.376818:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130357888:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 24us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360906.376823:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00080000:0.0:1788360906.376958:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788360906.401048:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788360906.465901:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360907.488301:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360908.512725:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360909.536376:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360909.984385:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144019840:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.984458:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360909.984516:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144020352:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.984544:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360909.984570:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788360909.984575:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144020224:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.984597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360909.984636:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144019968:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.984659:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360909.984675:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898533b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144020480:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.984707:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360909.984723:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788360909.984728:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144020096:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.984747:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360909.984776:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144019840 00000100:00100000:0.0:1788360909.984783:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144019840 00000100:00100000:0.0:1788360909.984828:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788360909.984837:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144019840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.984886:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144019840:12345-0@lo:400:kworker.0 Request processed in 49us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360909.984893:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788360909.984943:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144020352 00000100:00100000:0.0:1788360909.984947:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144020352 00000100:00100000:0.0:1788360909.984976:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144019968 00000100:00100000:0.0:1788360909.984989:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144019968 00000100:00100000:0.0:1788360909.985017:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144020096 00000100:00100000:0.0:1788360909.985020:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144020096 00000100:00100000:0.0:1788360909.985034:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788360909.985040:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144020352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.985075:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144020352:12345-0@lo:400:kworker.0 Request processed in 34us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360909.985081:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788360909.985117:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788360909.985123:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144019968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.985155:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144019968:12345-0@lo:400:kworker.0 Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360909.985161:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788360909.985172:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788360909.985177:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144020096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.985204:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144020096:12345-0@lo:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360909.985209:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788360909.985227:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144020224 00000100:00100000:0.0:1788360909.985230:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144020224 00000100:00100000:0.0:1788360909.985256:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144020480 00000100:00100000:0.0:1788360909.985259:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144020480 00000100:00100000:0.0:1788360909.985274:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788360909.985279:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144020224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.985309:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144020224:12345-0@lo:400:kworker.0 Request processed in 29us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360909.985314:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788360909.985323:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788360909.985335:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144020480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.985361:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144020480:12345-0@lo:400:kworker.0 Request processed in 27us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360909.985366:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788360909.985395:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788360909.985399:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788360909.985401:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360909.985434:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144020096:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.985444:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144019968:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.985452:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898533b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144020480:0@lo:400:kworker.0 00010000:00080000:0.0:1788360909.985483:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a83541880 x1875232144020224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360909.985493:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144020224:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.985500:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144019840:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.985508:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144020352:0@lo:400:kworker.0 00000100:00100000:0.0:1788360909.986871:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144020608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360909.987383:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360909.992681:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144020608 00000100:00100000:1.0:1788360909.992767:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144020608 00000100:00100000:1.0:1788360909.993146:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788360909.993158:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144020608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788360909.993198:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360909.993281:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144020608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (5898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360909.993288:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788360909.993374:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a8493b100 x1875232144020608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788360909.993397:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144020608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360910.496440:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788360910.496465:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144020736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788360910.496536:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360910.497022:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144020736 00000100:00100000:2.0:1788360910.497031:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144020736 00000100:00100000:2.0:1788360910.497109:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788360910.497119:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144020736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788360910.497160:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788360910.497226:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144020736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360910.500346:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788360910.501477:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144020736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788360910.561484:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360911.501433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360911.501485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360911.501571:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130358144 00000100:00100000:0.0:1788360911.501583:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130358144 00000100:00100000:0.0:1788360911.501661:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:0.0:1788360911.501673:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2352:x1875232130358144:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360911.501750:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2352:x1875232130358144:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360911.501758:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00080000:1.0:1788360911.501921:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360911.502041:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130358016 00000100:00100000:2.0:1788360911.502049:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130358016 00000100:00100000:2.0:1788360911.502114:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 270 00000100:00100000:2.0:1788360911.502134:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2352:x1875232130358016:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360911.502173:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2352:x1875232130358016:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 41us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360911.502179:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 270 00000100:00100000:1.0:1788360911.519914:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360911.519959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360911.520004:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130358272 00000100:00100000:0.0:1788360911.520015:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130358272 00000100:00100000:0.0:1788360911.520118:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788360911.520127:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2348:x1875232130358272:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1788360911.520156:0:9606:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66103fa 00000100:00080000:0.0:1788360911.520166:0:9606:0:(import.c:65:import_set_state_nolock()) ffff9a8abc489000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788360911.520194:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788360911.520209:0:9606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:1.0:1788360911.520265:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788360911.520479:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130358400 00000100:00100000:2.0:1788360911.520483:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130358400 00000100:00100000:2.0:1788360911.520527:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:2.0:1788360911.520533:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130358400:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360911.520592:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130358400:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 60us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360911.520600:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00080000:1.0:1788360911.520645:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360911.521020:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+2:2348:x1875232130358272:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 893us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360911.521027:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00010000:00010000:2.0:1788360911.585558:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360912.608290:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360913.634368:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360914.657342:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788360914.673416:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:1.0:1788360914.673425:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a83e4e800/11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:3.0:1788360914.673492:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e4e800/11e5d128-044a-45c3-b501-2dba6e5a82fa for lustre-OST0001 00000020:00000080:3.0:1788360914.673549:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8abc489000 for lustre-OST0001 00000100:00100000:2.0:1788360915.107466:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144020864:0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.107500:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144021248:0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.107539:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360915.107587:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788360915.107592:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144021376:0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.107625:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360915.107650:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144021120:0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.107670:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360915.107677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360915.107685:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788360915.107691:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144020992:0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.107714:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360915.107732:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144020864 00000100:00100000:3.0:1788360915.107734:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144021504:0@lo:400:kworker.0 00000100:00100000:2.0:1788360915.107739:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144020864 00000100:00100000:3.0:1788360915.107756:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360915.107786:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788360915.107790:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144021248 00000100:00100000:3.0:1788360915.107795:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144021248 00000100:00100000:2.0:1788360915.107799:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144020864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.107841:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144021504 00000100:00100000:3.0:1788360915.107845:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144021504 00000100:00100000:3.0:1788360915.107870:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788360915.107876:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144020864:12345-0@lo:400:kworker.0 Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360915.107882:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144021248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360915.107890:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788360915.107923:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144021248:12345-0@lo:400:kworker.0 Request processed in 43us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360915.107927:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144021376 00000100:00100000:3.0:1788360915.107931:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788360915.107933:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144021376 00000100:00100000:3.0:1788360915.107963:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788360915.107970:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144021504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360915.107978:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144021120 00000100:00100000:2.0:1788360915.107983:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144021120 00000100:00100000:3.0:1788360915.108003:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144021504:12345-0@lo:400:kworker.0 Request processed in 34us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360915.108007:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144020992 00000100:00100000:3.0:1788360915.108011:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788360915.108018:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144020992 00000100:00100000:3.0:1788360915.108032:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788360915.108046:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144021376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.108070:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144021376:12345-0@lo:400:kworker.0 Request processed in 31us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360915.108166:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788360915.108175:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144021120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360915.108209:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144021120:12345-0@lo:400:kworker.0 Request processed in 36us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360915.108216:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788360915.108228:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788360915.108233:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144020992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360915.108257:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144020992:12345-0@lo:400:kworker.0 Request processed in 24us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360915.108262:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788360915.108279:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788360915.108326:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144020992:0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.108335:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144021504:0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.108343:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144021120:0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.108386:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144021376:0@lo:400:kworker.0 00010000:00080000:3.0:1788360915.108398:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a89865ba680 x1875232144021248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788360931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360915.108414:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144020864:0@lo:400:kworker.0 00000100:00100000:3.0:1788360915.108427:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144021248:0@lo:400:kworker.0 00000100:00080000:1.0:1788360915.108571:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788360915.108576:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788360915.108578:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788360915.108732:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788360915.108742:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144021632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360915.108770:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360915.108836:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144021632 00000100:00100000:1.0:1788360915.108841:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144021632 00000100:00100000:1.0:1788360915.108879:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788360915.108886:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144021632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788360915.108913:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360915.108961:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144021632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360915.108967:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788360915.109022:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a84938380 x1875232144021632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788360931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360915.109035:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144021632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360915.616316:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788360915.616341:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144021760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788360915.616413:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360915.618268:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144021760 00000100:00100000:1.0:1788360915.618284:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144021760 00000100:00100000:1.0:1788360915.618440:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788360915.618452:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144021760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788360915.618494:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360915.618589:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144021760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360915.618597:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788360915.618702:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144021760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788360915.680330:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788360916.359706:0:11701:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:55:15 (1788360915) 00000100:00100000:1.0:1788360916.615720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360916.615805:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360916.615879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360916.615949:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130358528 00000100:00100000:0.0:1788360916.615959:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130358528 00000100:00100000:0.0:1788360916.616018:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 272 00000100:00100000:0.0:1788360916.616028:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130358528:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360916.616134:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130358528:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360916.616155:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 272 00000100:00100000:3.0:1788360916.616724:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130358656 00000100:00100000:3.0:1788360916.616730:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130358656 00000100:00080000:1.0:1788360916.616795:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360916.616983:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130358784 00000100:00100000:2.0:1788360916.616989:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130358784 00000100:00100000:3.0:1788360916.616993:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:3.0:1788360916.617005:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130358656:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360916.617040:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:2.0:1788360916.617049:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130358784:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360916.617058:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130358656:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 55us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360916.617066:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00080000:1.0:1788360916.617161:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360916.618480:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130358784:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1422us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360916.618491:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000040:00080000:0.0:1788360916.640746:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788360916.704679:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360917.646413:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360917.646540:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130358912 00000100:00100000:3.0:1788360917.646551:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130358912 00000100:00100000:3.0:1788360917.646616:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:3.0:1788360917.646625:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:10182:x1875232130358912:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788360917.646646:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360917.646669:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66104c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1f1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.646741:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66104cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.646766:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66104cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.646778:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66104cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360917.646993:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788360917.646997:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788360917.647465:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66104cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.647489:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66104c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1f1 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.647504:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66104cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1f1 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.647511:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:3.0:1788360917.647514:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788360917.647516:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:3.0:1788360917.647580:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:10182:x1875232130358912:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 956us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360917.647588:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:1.0:1788360917.656567:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360917.656772:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130359040 00000100:00100000:0.0:1788360917.656781:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130359040 00000100:00100000:0.0:1788360917.656856:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1788360917.656866:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:10183:x1875232130359040:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788360917.656897:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360917.656920:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66104d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1f8 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.656999:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66104da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657015:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66104da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657026:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66104da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657041:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66104e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657049:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66104e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657056:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66104e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657548:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66104e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657564:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66104e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657573:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66104e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360917.657677:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788360917.657681:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788360917.657763:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66104e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657774:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66104da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657781:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66104da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657787:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66104da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657793:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360917.657797:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66104da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657805:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66104da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657817:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:0.0:1788360917.657821:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360917.657825:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66104da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657845:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66104da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657858:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66104e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657864:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66104e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657869:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66104e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657873:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360917.657876:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66104e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657881:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66104e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657888:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a8a983bf200) 00010000:00010000:0.0:1788360917.657890:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360917.657892:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66104e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657897:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66104e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657938:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66104d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1f8 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657951:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66104e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1f8 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360917.657964:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a983bf900) 00010000:00010000:0.0:1788360917.657966:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788360917.657969:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42000, rc 0) 00000100:00100000:0.0:1788360917.658044:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:10183:x1875232130359040:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1178us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360917.658053:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1788360917.662791:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360917.662900:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130359296 00000100:00100000:3.0:1788360917.662910:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130359296 00000100:00100000:3.0:1788360917.663030:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1788360917.663041:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:10183:x1875232130359296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788360917.663063:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360917.663138:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66104ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e1ff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.663212:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66104f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.663226:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66104f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.663237:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66104f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.663308:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66104fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.663317:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66104fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.663323:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66104fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664327:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610504 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664342:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610504 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664350:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610504 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360917.664361:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788360917.664562:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66104f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664580:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66104f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664586:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66104f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664592:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360917.664597:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66104f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664604:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66104f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664617:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a983bf900) 00010000:00010000:3.0:1788360917.664620:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360917.664625:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66104f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664631:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66104f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664642:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66104fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.664648:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66104fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.667015:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66104fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.667024:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360917.667043:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66104fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.667052:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66104fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.667067:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a99526d00) 00010000:00010000:3.0:1788360917.667070:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360917.667075:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66104fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.667081:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66104fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.667722:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66104ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ff expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.667740:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610504 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ff expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360917.667749:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:3.0:1788360917.667751:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360917.667754:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f600, rc 0) 00000100:00100000:3.0:1788360917.668050:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:10183:x1875232130359296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 5010us (5270us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788360917.668060:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788360917.678362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360917.679270:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130359424 00000100:00100000:0.0:1788360917.679281:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130359424 00000100:00100000:0.0:1788360917.679389:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788360917.679400:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:10183:x1875232130359424:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788360917.679516:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:10183:x1875232130359424:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 118us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360917.679523:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00010000:00010000:0.0:1788360917.728804:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788360918.688686:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788360918.756452:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360919.192372:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.193053:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130359552 00000100:00100000:3.0:1788360919.193064:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130359552 00000100:00080000:1.0:1788360919.193234:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360919.194277:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1788360919.194293:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:10226:x1875232130359552:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360919.194322:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360919.194343:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e206 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194410:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610519 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194426:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194439:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194553:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610520 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194562:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194570:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194828:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194836:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610519 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194842:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610519 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194848:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360919.194858:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610519 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194866:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610519 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194879:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:3.0:1788360919.194882:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360919.194886:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194892:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194904:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194910:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610520 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194926:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194931:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360919.194934:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194941:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610520 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194948:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a8a99526d00) 00010000:00010000:3.0:1788360919.194950:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360919.194959:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610520 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.194965:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610520 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.195136:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610512 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e206 expref: 10 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.195148:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:3.0:1788360919.195150:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360919.195153:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e206 expref: 10 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.195162:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fa00, rc 0) 00000100:00100000:3.0:1788360919.195296:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:10226:x1875232130359552:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1007us (2932us total) trans 0 rc 301/301 00000100:00100000:3.0:1788360919.195304:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788360919.201169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.201407:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130359808 00000100:00100000:3.0:1788360919.201418:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130359808 00000100:00100000:3.0:1788360919.201468:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:3.0:1788360919.201478:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:10226:x1875232130359808:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:3.0:1788360919.201535:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360919.201564:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66104cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1f1 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.201579:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:3.0:1788360919.201592:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360919.201909:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610527 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.203527:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610527 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.203541:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610527 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.203563:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.203570:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.203578:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360919.207892:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788360919.207913:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610527 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.207935:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610527 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.207943:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610527 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.207949:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360919.207954:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610527 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.207962:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610527 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.207996:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526200) 00010000:00010000:3.0:1788360919.208000:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360919.208006:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610527 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.208012:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610527 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788360919.208033:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb6f7666 reply state 00000000d9eafb8b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360919.208042:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788360919.208169:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:10226:x1875232130359808:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 6688us (7007us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788360919.208191:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00010000:00010000:0.0:1788360919.212874:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.212888:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.212895:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.212901:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360919.212906:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.212933:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.212950:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a8a99526400) 00010000:00010000:0.0:1788360919.212953:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360919.212958:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.212963:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661052e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360919.307150:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.307186:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130359936 00000100:00100000:0.0:1788360919.307198:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130359936 00000100:00100000:0.0:1788360919.307256:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788360919.307266:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:10234:x1875232130359936:12345-192.168.203.60@tcp:101:lctl.0 00010000:00010000:0.0:1788360919.307292:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360919.307317:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e20d expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.307386:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d661053c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.307402:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d661053c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.307415:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d661053c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360919.307477:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788360919.307488:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788360919.307533:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d661053c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.307556:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e20d expref: 11 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.307982:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d661053c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e20d expref: 10 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.307991:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:0.0:1788360919.307994:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788360919.307998:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42600, rc 0) 00000100:00100000:0.0:1788360919.308059:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:10234:x1875232130359936:12345-192.168.203.60@tcp:101:lctl.0 Request processed in 794us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360919.308067:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:1.0:1788360919.352117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.352197:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130360064 00000100:00100000:0.0:1788360919.352207:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130360064 00000100:00100000:0.0:1788360919.352270:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:0.0:1788360919.352281:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:10240:x1875232130360064:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788360919.352302:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360919.352323:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e214 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352385:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d661054a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352399:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d661054a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352431:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d661054a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352446:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610551 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352453:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352459:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352577:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d6610558 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352587:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d6610558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352594:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d6610558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360919.352626:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1788360919.352630:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788360919.352714:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d6610558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352727:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d661054a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352734:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d661054a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352751:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d661054a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352758:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360919.352762:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d661054a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352770:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d661054a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352782:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:0.0:1788360919.352785:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360919.352789:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d661054a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352797:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d661054a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352810:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352817:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610551 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352835:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352840:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360919.352843:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352859:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610551 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352869:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a8a983bff00) 00010000:00010000:0.0:1788360919.352871:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360919.352874:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610551 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352879:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610551 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352910:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e214 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352934:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d6610558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e214 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.352941:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:0.0:1788360919.352943:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788360919.352954:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43000, rc 0) 00000100:00100000:0.0:1788360919.353026:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:10240:x1875232130360064:12345-192.168.203.60@tcp:101:bash.0 Request processed in 747us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360919.353034:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:0.0:1788360919.356189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.356364:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130360320 00000100:00100000:3.0:1788360919.356374:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130360320 00000100:00100000:3.0:1788360919.356435:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1788360919.356445:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:10240:x1875232130360320:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788360919.356466:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360919.356486:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661055f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e21b expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.356629:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610566 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.356645:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610566 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.356680:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610566 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.356745:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.356754:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.356760:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788360919.357421:0:6736:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788360919.357599:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357610:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357620:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357654:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610566 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357662:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610566 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357669:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610566 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357675:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360919.357687:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610566 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357696:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610566 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357709:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:3.0:1788360919.357712:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360919.357716:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610566 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357723:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610566 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788360919.357737:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000562a0be1 reply state 000000008c82bc30 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360919.357746:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788360919.357782:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661055f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e21b expref: 14 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357797:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e21b expref: 13 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.357804:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:3.0:1788360919.357807:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788360919.357809:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ec00, rc 0) 00000100:00100000:3.0:1788360919.357883:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:10240:x1875232130360320:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1438us (1703us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788360919.357892:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00010000:00010000:3.0:1788360919.360373:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.360390:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.360397:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.360403:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360919.360408:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.360416:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.360434:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a99526200) 00010000:00010000:3.0:1788360919.360437:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360919.360442:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.360448:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661056d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360919.363558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.363627:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130360448 00000100:00100000:3.0:1788360919.363637:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130360448 00000100:00100000:3.0:1788360919.363725:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1788360919.363733:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875232130360448:12345-192.168.203.60@tcp:8:bash.0 00010000:00080000:3.0:1788360919.363765:0:6594:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:3.0:1788360919.363796:0:6594:0:(genops.c:1406:class_connect()) connect: client 11e5d128-044a-45c3-b501-2dba6e5a82fa, cookie 0xf6a94c97d6610582 00002000:00100000:3.0:1788360919.363807:0:6594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 11e5d128-044a-45c3-b501-2dba6e5a82fa/ffff9a8a8a12e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788360919.363935:0:6594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788360919.364583:0:6594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788360919.364617:0:6594:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a10b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788360919.364692:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2348:x1875232130360448:12345-192.168.203.60@tcp:8:bash.0 Request processed in 957us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360919.364701:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788360919.366512:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.366590:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130360576 00000100:00100000:3.0:1788360919.366601:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130360576 00000100:00100000:3.0:1788360919.366675:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:3.0:1788360919.366684:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:0:x1875232130360576:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788360919.366700:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360919.366723:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6610589 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e222 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788360919.366751:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788360919.366772:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1788360919.366777:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788360919.366786:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6610589 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e222 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.366806:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6610589 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e222 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.366819:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f400, rc 0) 00000100:00080000:1.0:1788360919.366966:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788360919.367020:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:0:x1875232130360576:12345-192.168.203.60@tcp:101:bash.0 Request processed in 336us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360919.367027:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788360919.372865:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.372952:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130360704 00000100:00100000:0.0:1788360919.372963:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130360704 00000100:00100000:0.0:1788360919.373022:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788360919.373049:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:10240:x1875232130360704:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788360919.373069:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360919.373132:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e229 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.373166:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6610589 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e222 expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.373176:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360919.373180:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360919.373253:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.373290:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6610589 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e222 expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.373304:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6610589 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e222 expref: 8 pid: 6593 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360919.373319:0:6592:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6592:1875232144021888:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360919.373403:0:6592:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360919.378064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.378204:0:6592:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6592:1875232144021888:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360919.378236:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.378282:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43e00, rc 0) 00000100:00100000:3.0:1788360919.378339:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:10240:x1875232130360704:12345-192.168.203.60@tcp:101:bash.0 Request processed in 5292us (5483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360919.378346:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788360919.382512:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130360832 00000100:00100000:1.0:1788360919.382587:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130360832 00010000:00010000:1.0:1788360919.382644:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6610589 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e222 expref: 8 pid: 6593 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360919.382732:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:1.0:1788360919.382758:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130360832:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360919.382776:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360919.382802:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6610589 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e222 expref: 8 pid: 6593 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.382817:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6610589 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e222 expref: 8 pid: 6593 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.382842:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6610589 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e222 expref: 8 pid: 6593 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.382860:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788360919.382864:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788360919.382873:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.382884:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.382950:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360919.382965:0:5783:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5783:1875232144022016:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788360919.383046:0:5783:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026240 going to sleep for 11 seconds 00000100:00100000:0.0:1788360919.388991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360919.389011:0:5783:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5783:1875232144022016:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788360919.389055:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360919.389258:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130360832:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 6501us (11202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360919.389269:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788360919.389362:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130361088 00000100:00100000:2.0:1788360919.389370:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130361088 00000100:00100000:2.0:1788360919.389426:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788360919.389436:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:10240:x1875232130361088:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1788360919.389765:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:10240:x1875232130361088:12345-192.168.203.60@tcp:35:bash.0 Request processed in 330us (784us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788360919.389772:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788360919.477183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.477892:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130361344 00000100:00100000:3.0:1788360919.477906:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130361344 00000100:00100000:3.0:1788360919.477972:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:3.0:1788360919.477982:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:10250:x1875232130361344:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360919.478008:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360919.478032:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e230 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360919.478342:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788360919.478462:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610597 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e230 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.478477:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:3.0:1788360919.478480:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788360919.478485:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e230 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.478500:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fa00, rc 0) 00000100:00100000:3.0:1788360919.478571:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:10250:x1875232130361344:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 591us (1405us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788360919.478579:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:1.0:1788360919.483998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360919.484481:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130361600 00000100:00100000:2.0:1788360919.484492:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130361600 00000100:00100000:2.0:1788360919.484547:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788360919.484555:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:10250:x1875232130361600:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788360919.484812:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:10250:x1875232130361600:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 256us (822us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788360919.484819:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788360919.585605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.585672:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130361728 00000100:00100000:3.0:1788360919.585681:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130361728 00000100:00100000:3.0:1788360919.585736:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1788360919.585745:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:10256:x1875232130361728:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360919.586295:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360919.586319:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66105a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e237 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.587042:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66105ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.587059:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66105ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.587072:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66105ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360919.587158:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1788360919.587163:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788360919.587188:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66105ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.587216:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66105a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e237 expref: 18 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.587234:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66105ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e237 expref: 17 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.587242:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:3.0:1788360919.587245:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788360919.587261:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f200, rc 0) 00000100:00100000:3.0:1788360919.587341:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:10256:x1875232130361728:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1596us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360919.587350:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788360919.594159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.597579:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130361984 00000100:00100000:0.0:1788360919.597595:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130361984 00000100:00100000:0.0:1788360919.598224:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:0.0:1788360919.598237:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:10256:x1875232130361984:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360919.598260:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360919.598282:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66105b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e23e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.598390:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66105ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.598406:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66105ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.598428:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66105ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360919.598440:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788360919.599074:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66105b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e23e expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.599132:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66105ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e23e expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.599143:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:0.0:1788360919.599147:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788360919.599152:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42200, rc 0) 00000100:00100000:0.0:1788360919.599246:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:10256:x1875232130361984:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1011us (5095us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788360919.599269:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:1.0:1788360919.604150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.606985:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130362240 00000100:00100000:0.0:1788360919.607001:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130362240 00000100:00100000:0.0:1788360919.607192:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1788360919.607204:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:10256:x1875232130362240:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360919.607231:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360919.607254:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e245 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.607361:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66105cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.607378:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66105cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.607390:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66105cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360919.607403:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788360919.607606:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e245 expref: 22 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.607625:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66105cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e245 expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.607634:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:0.0:1788360919.607637:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788360919.607641:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43200, rc 0) 00000100:00100000:0.0:1788360919.607728:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:10256:x1875232130362240:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 525us (3585us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788360919.607735:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:2.0:1788360919.607836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.607990:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130362368 00000100:00100000:0.0:1788360919.607995:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130362368 00000100:00100000:0.0:1788360919.608206:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1788360919.608216:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:2350:x1875232130362368:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360919.608226:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360919.608243:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66105ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e23e expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.608256:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:0.0:1788360919.608259:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360919.608283:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:2350:x1875232130362368:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 70us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360919.608289:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1788360919.626691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.626871:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130362496 00000100:00100000:0.0:1788360919.626960:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130362496 00000100:00100000:0.0:1788360919.627071:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788360919.627081:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130362496:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:0.0:1788360919.627164:0:9606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.627198:0:9606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.627206:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360919.627225:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788360919.627231:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.627268:0:9606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.627281:0:9606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 7 pid: 6592 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360919.627294:0:9606:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9606:1875232144022144:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360919.627368:0:9606:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360919.638486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360919.638632:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130362624 00000100:00100000:2.0:1788360919.638643:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130362624 00002000:00100000:2.0:1788360919.638686:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9a8ab71b0000 x1875232130362624/t0(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:735/0 lens 504/0 e 0 to 0 dl 1788360930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788360919.638717:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b0000 with x1875232130362624 ext(0->12) 00010000:00010000:2.0:1788360919.638728:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 8 pid: 6592 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.638744:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 8 pid: 6592 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788360919.638751:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8ab71b0000 00000100:00100000:2.0:1788360919.638784:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788360919.638793:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2349:x1875232130362624:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:0.0:1788360919.639747:0:9606:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9606:1875232144022144:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360919.639770:0:9606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788360919.681420:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000100:00100000:0.0:1788360919.682450:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2349:x1875232130362624:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 43650us (43964us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788360919.682468:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:0.0:1788360919.682482:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9a8ab71b0000 x1875232130362624/t4294967299(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:735/0 lens 504/448 e 0 to 0 dl 1788360930 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788360919.682491:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b0000 with x1875232130362624 ext(0->12) 00010000:00010000:0.0:1788360919.682503:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 9 pid: 6592 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.682536:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 9 pid: 6592 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788360919.682544:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8ab71b0000 00000100:00100000:1.0:1788360919.684975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.685535:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130362752 00000100:00100000:0.0:1788360919.685546:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130362752 00010000:00010000:0.0:1788360919.685587:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 9 pid: 6592 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360919.685623:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:0.0:1788360919.685632:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2350:x1875232130362752:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360919.685649:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788360919.685668:0:8303:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788360919.685671:0:8303:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788360920 00002000:00010000:0.0:1788360919.685673:0:8303:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788360920 00002000:00010000:0.0:1788360919.685675:0:8303:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788360920 00010000:00010000:0.0:1788360919.685681:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 9 pid: 6592 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.685696:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 9 pid: 6592 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.685725:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c43af579/0xf6a94c97d6610590 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e229 expref: 9 pid: 6592 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.685760:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788360919.685764:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788360919.685771:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.685781:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.685930:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360919.685994:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130362752:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 362us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360919.686003:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00010000:00010000:3.0:1788360919.686949:0:9606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.686962:0:9606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.686993:0:9606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.687002:0:9606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.687010:0:9606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.687018:0:9606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788360919.687022:0:9606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.687031:0:9606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.687046:0:9606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.687067:0:9606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8070b20/0xf6a94c97d66105dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360919.687774:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130362496:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 60690us (61087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360919.687786:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1788360919.689701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.689769:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130363008 00000100:00100000:0.0:1788360919.689779:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130363008 00000100:00100000:0.0:1788360919.689832:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788360919.689842:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:10256:x1875232130363008:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:0.0:1788360919.689902:0:5801:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66105cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e245 expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788360919.690242:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788360919.690305:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788360919.690966:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788360919.691028:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.691046:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e21b expref: 24 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.691062:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.691121:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e21b expref: 24 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.691136:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e21b expref: 24 pid: 6736 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360919.691151:0:5801:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1875232144022272:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360919.691240:0:5801:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788360919.694016:0:5801:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1875232144022272:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360919.694043:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360919.694670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.695072:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130363136 00000100:00100000:0.0:1788360919.695082:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130363136 00010000:00010000:0.0:1788360919.695274:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e21b expref: 25 pid: 6736 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360919.695353:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1788360919.695366:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+25:2350:x1875232130363136:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360919.695385:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360919.695392:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e21b expref: 25 pid: 6736 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.695437:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e21b expref: 25 pid: 6736 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.695460:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e21b expref: 25 pid: 6736 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.695476:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:0.0:1788360919.695482:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.695490:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.695498:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.695528:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360919.695582:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:2350:x1875232130363136:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 219us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360919.695590:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00010000:00010000:3.0:1788360919.695637:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.695645:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788360919.695760:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788360919.695960:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788360919.696063:0:5801:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f92680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144022400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788360919.696131:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360919.696158:0:5801:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bada480 going to sleep for 11 seconds 00000100:00100000:1.0:1788360919.696633:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144022400 00000100:00100000:1.0:1788360919.696640:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144022400 00000100:00100000:1.0:1788360919.696694:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788360919.696703:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1875232144022400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788360919.696783:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1875232144022400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360919.696790:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788360919.696934:0:5801:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f92680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144022400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788360919.697641:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788360919.697728:0:5801:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144022528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788360919.697775:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360919.697808:0:5801:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a890266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360919.697831:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144022528 00000100:00100000:1.0:1788360919.697837:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144022528 00000100:00100000:1.0:1788360919.697868:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788360919.697875:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1875232144022528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788360919.698050:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5801:x1875232144022528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 174us (274us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788360919.698062:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788360919.698122:0:5801:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144022528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788360919.698164:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788360919.698198:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.698207:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.698214:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.698221:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360919.698226:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.698234:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.698248:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:1.0:1788360919.698251:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788360919.698255:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360919.698261:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66105e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788360919.698424:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788360919.698631:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788360919.698642:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309713555717ns, next at 310713553988ns, rc = 0 00000001:00080000:1.0:1788360919.698655:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788360919.698689:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:1.0:1788360919.698693:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788360919.698699:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66105cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e245 expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360919.698793:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:10256:x1875232130363008:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 8952us (9101us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788360919.698801:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000020:00080000:1.0:1788360919.698805:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1788360919.699315:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788360919.701254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.701380:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130363264 00000100:00100000:3.0:1788360919.701391:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130363264 00000100:00100000:3.0:1788360919.701467:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:3.0:1788360919.701477:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:10256:x1875232130363264:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360919.701500:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360919.701523:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66105eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e24c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.701590:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66105eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e24c expref: 28 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.701624:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66105eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e24c expref: 28 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.701649:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:3.0:1788360919.701653:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788360919.701658:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fa00, rc 0) 00000100:00100000:3.0:1788360919.701726:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:10256:x1875232130363264:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 250us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360919.701733:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:1.0:1788360919.705242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.705507:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130363520 00000100:00100000:3.0:1788360919.705517:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130363520 00000100:00100000:3.0:1788360919.705575:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788360919.705585:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f88c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:10256:x1875232130363520:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788360919.705813:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f88c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:10256:x1875232130363520:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 228us (582us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788360919.705821:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000001:00080000:3.0:1788360919.755718:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967320 is committed 00000001:00080000:3.0:1788360919.755749:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967325 is committed 00000004:00080000:3.0:1788360919.755755:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788360919.755782:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a890263c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788360919.755787:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ab6cb9f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a890269c0 00000020:00080000:3.0:1788360919.755790:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ab6cb9300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ab7221c00 00000001:00080000:3.0:1788360919.755812:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000020:00080000:0.0:1788360919.755875:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788360919.756012:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788360919.756217:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360919.756237:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144022656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788360919.756303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360919.756460:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144022656 00000100:00100000:2.0:1788360919.756468:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144022656 00000100:00100000:2.0:1788360919.756517:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788360919.756526:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144022656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788360919.756553:0:6594:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788360919.756585:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9838d8, atime: 0x6a9838d8, ctime: 0x6a9838d8, blocks: 0x1 00010000:00010000:2.0:1788360919.756594:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66105f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.756610:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1788360919.756614:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360919.756620:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66105f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.756654:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66105f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.756665:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66105f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.756672:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66105f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.756691:0:6594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788360919.757210:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144022656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 683us (904us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788360919.757217:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788360919.757242:0:11019:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360919.757249:0:11019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66105f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.757257:0:11019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788360919.757262:0:11019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66105f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.757271:0:11019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66105f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.757288:0:11019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66105f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.757303:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66105f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.757321:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360919.757323:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360919.757324:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788360919.757465:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a83f99500/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788360919.757472:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144022656:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788360919.776693:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360919.782181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.782271:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130363776 00000100:00100000:0.0:1788360919.782282:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130363776 00000100:00100000:0.0:1788360919.782342:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1788360919.782352:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:10266:x1875232130363776:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360919.782383:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360919.782404:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66105f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e253 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360919.782698:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788360919.782932:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66105f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e253 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.782948:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:0.0:1788360919.782952:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788360919.782957:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66105f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e253 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.782972:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43e00, rc 0) 00000100:00100000:0.0:1788360919.783036:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:10266:x1875232130363776:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 684us (870us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788360919.783043:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:2.0:1788360919.786373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.786544:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130363904 00000100:00100000:3.0:1788360919.786569:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130363904 00000100:00100000:3.0:1788360919.786632:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:3.0:1788360919.786642:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:10266:x1875232130363904:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788360919.786716:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610607 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.786735:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.786748:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.786764:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661060e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.786771:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661060e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.786778:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661060e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.792843:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.792861:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.792875:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360919.792935:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.792950:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.792957:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610607 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.792964:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.792970:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360919.792974:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.792991:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610607 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793006:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:2.0:1788360919.793009:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360919.793014:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793020:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793034:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661060e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793040:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661060e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793046:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661060e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793052:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360919.793054:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661060e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793060:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661060e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793067:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a83c0b500) 00010000:00010000:2.0:1788360919.793069:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360919.793072:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661060e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793108:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661060e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793124:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793130:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793136:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793142:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360919.793145:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793151:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793160:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:2.0:1788360919.793162:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360919.793166:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360919.793171:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360919.793455:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:10266:x1875232130363904:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 6808us (7085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360919.793467:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:1.0:1788360919.796259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.796674:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130364160 00000100:00100000:3.0:1788360919.796683:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130364160 00000100:00100000:3.0:1788360919.796731:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788360919.796740:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:10266:x1875232130364160:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788360919.797772:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:10266:x1875232130364160:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 1027us (1515us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788360919.797783:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788360919.826630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360919.826746:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130364416 00000100:00100000:0.0:1788360919.826756:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130364416 00000100:00100000:0.0:1788360919.826849:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:0.0:1788360919.826859:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:10269:x1875232130364416:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360919.826883:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360919.826925:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661061c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e25a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827004:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610623 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827018:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827030:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827055:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661062a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827063:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661062a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827071:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661062a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827777:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827789:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827798:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360919.827809:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788360919.827897:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827926:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610623 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827933:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827939:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360919.827943:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827951:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610623 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827963:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:0.0:1788360919.827966:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360919.827970:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610623 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827976:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610623 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827991:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661062a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.827997:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661062a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.828003:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661062a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.828007:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360919.828017:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661062a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.828024:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661062a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.828032:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a983bf600) 00010000:00010000:0.0:1788360919.828034:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360919.828353:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661062a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.828360:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661062a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.828410:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661061c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e25a expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.828424:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e25a expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360919.828642:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360919.828645:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788360919.828647:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43800, rc 0) 00000100:00100000:0.0:1788360919.828750:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:10269:x1875232130364416:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1890us (2128us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788360919.828759:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:2.0:1788360919.832081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360919.836328:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130364544 00000100:00100000:3.0:1788360919.836339:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130364544 00000100:00100000:3.0:1788360919.836421:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788360919.836430:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:10269:x1875232130364544:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:3.0:1788360919.836496:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661063f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.836514:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661063f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.836524:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661063f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.836552:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661063f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.836558:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661063f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.836565:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661063f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.836571:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360919.836575:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661063f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.836583:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661063f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.836593:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:3.0:1788360919.836596:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788360919.836601:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661063f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360919.836617:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661063f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360919.837181:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:10269:x1875232130364544:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 746us (5105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360919.837190:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:1.0:1788360919.838855:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360919.839548:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130364800 00000100:00100000:2.0:1788360919.839560:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130364800 00000100:00100000:2.0:1788360919.839652:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788360919.839662:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:10269:x1875232130364800:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788360919.839919:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:10269:x1875232130364800:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 249us (1062us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788360919.839928:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788360920.077417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360920.077511:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130365056 00000100:00100000:3.0:1788360920.077521:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130365056 00000100:00100000:3.0:1788360920.077580:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:3.0:1788360920.077589:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:10300:x1875232130365056:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1788360920.077611:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360920.077629:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610646 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e261 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360920.077718:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661064d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360920.077733:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661064d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360920.077745:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661064d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360920.077755:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788360920.077890:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610646 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e261 expref: 19 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360920.077921:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661064d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e261 expref: 18 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360920.077948:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:3.0:1788360920.077951:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788360920.077955:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e400, rc 0) 00000100:00100000:3.0:1788360920.078015:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:10300:x1875232130365056:12345-192.168.203.60@tcp:101:cat.0 Request processed in 426us (608us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788360920.078022:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:1.0:1788360920.083855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360920.083899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360920.083985:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130365440 00000100:00100000:3.0:1788360920.083996:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130365440 00000100:00100000:3.0:1788360920.084057:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788360920.084070:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:10300:x1875232130365440:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:3.0:1788360920.084371:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:10300:x1875232130365440:12345-192.168.203.60@tcp:35:cat.0 Request processed in 304us (525us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788360920.084379:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788360920.084777:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130365184 00000100:00100000:0.0:1788360920.084782:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130365184 00000100:00100000:0.0:1788360920.084826:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788360920.084834:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:2349:x1875232130365184:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360920.084861:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360920.084885:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661064d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e261 expref: 19 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.084902:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360920.084915:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360920.084951:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:2349:x1875232130365184:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 118us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360920.084957:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1788360920.142638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360920.142743:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130365696 00000100:00100000:2.0:1788360920.142753:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130365696 00000100:00100000:2.0:1788360920.142847:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1788360920.142857:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:10306:x1875232130365696:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788360920.142881:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360920.142884:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788360920.142918:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66105ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e237 expref: 18 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.142937:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:2.0:1788360920.142942:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788360920.142955:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661065b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e268 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.143048:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.143062:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e25a expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.143134:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.143165:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e25a expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.143187:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e25a expref: 18 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360920.143201:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f9bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144022784:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360920.143289:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788360920.145482:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f9bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144022784:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360920.145507:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360920.147636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360920.147861:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130365824 00000100:00100000:0.0:1788360920.147872:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130365824 00010000:00010000:0.0:1788360920.147918:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e25a expref: 19 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360920.147996:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788360920.148005:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:2350:x1875232130365824:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360920.148019:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360920.148025:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e25a expref: 19 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.148038:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e25a expref: 19 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.148060:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e25a expref: 19 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.148074:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360920.148109:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.148118:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.148126:0:8303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.148150:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360920.148220:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:2350:x1875232130365824:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 216us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360920.148228:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00010000:00010000:2.0:1788360920.148288:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.148296:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360920.148314:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788360920.148481:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661065b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e268 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.148498:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e268 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.148516:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:2.0:1788360920.148519:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788360920.148521:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f400, rc 0) 00000100:00100000:2.0:1788360920.148557:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:10306:x1875232130365696:12345-192.168.203.60@tcp:101:dd.0 Request processed in 5702us (5930us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788360920.148565:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:1.0:1788360920.152297:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360920.152427:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130366080 00000100:00100000:0.0:1788360920.152437:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130366080 00000100:00100000:0.0:1788360920.152495:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:0.0:1788360920.152505:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:10306:x1875232130366080:12345-192.168.203.60@tcp:36:dd.0 00010000:00010000:0.0:1788360920.152782:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.152799:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.152810:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788360920.152860:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788360920.152972:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d3a82ed reply state 0000000032595333 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360920.152981:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788360920.153353:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:10306:x1875232130366080:12345-192.168.203.60@tcp:36:dd.0 Request processed in 848us (1064us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788360920.153362:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000020:00080000:0.0:1788360920.153367:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788360920.156217:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.156235:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.156243:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.156249:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360920.156254:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.156261:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.156278:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360920.156281:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360920.156286:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.156292:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610670 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360920.225029:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144023040:0@lo:400:kworker.0 00000100:00100000:3.0:1788360920.225035:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144023296:0@lo:400:kworker.0 00000100:00100000:1.0:1788360920.225141:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144023168:0@lo:400:kworker.0 00000100:00100000:2.0:1788360920.225213:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144022912:0@lo:400:kworker.0 00000100:00100000:0.0:1788360920.226897:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360920.226974:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144023552:0@lo:400:kworker.0 00000100:00100000:0.0:1788360920.227035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360920.227052:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360920.227083:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144023680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360920.227116:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144023552 00000100:00100000:0.0:1788360920.227125:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144023552 00000100:00100000:1.0:1788360920.227126:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360920.227191:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788360920.227201:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144023552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360920.227259:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144023552:12345-0@lo:400:kworker.0 Request processed in 59us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360920.227267:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788360920.227287:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788360920.227386:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144023040 00000100:00100000:1.0:1788360920.227392:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144023040 00000100:00100000:1.0:1788360920.227427:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144023168 00000100:00100000:1.0:1788360920.227431:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144023168 00000100:00100000:1.0:1788360920.227454:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788360920.227461:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144023040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360920.228420:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144023552:0@lo:400:kworker.0 00000100:00080000:0.0:1788360920.228455:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360920.228594:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788360920.228606:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144023168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360920.233565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360920.233624:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144023424:0@lo:400:kworker.0 00000100:00100000:0.0:1788360920.233696:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144023168:12345-0@lo:400:kworker.0 Request processed in 5091us (6643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360920.233706:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788360920.233767:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144023168:0@lo:400:kworker.0 00000100:00100000:1.0:1788360920.233945:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144023040:12345-0@lo:400:kworker.0 Request processed in 6483us (7052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360920.233954:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788360920.234107:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144023040:0@lo:400:kworker.0 00000100:00100000:1.0:1788360920.234145:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144023680 00000100:00100000:1.0:1788360920.234151:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144023680 00000100:00100000:1.0:1788360920.234203:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788360920.234215:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144023680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788360920.234238:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360920.234277:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144023680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (7151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360920.234283:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788360920.234316:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144022912 00000100:00100000:1.0:1788360920.234320:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144022912 00000100:00100000:1.0:1788360920.234344:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788360920.234350:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144022912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360920.234379:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144022912:12345-0@lo:400:kworker.0 Request processed in 30us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360920.234385:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788360920.234577:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144023680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788360920.235353:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360920.235409:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144023296 00000100:00100000:0.0:1788360920.235415:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144023296 00000100:00100000:0.0:1788360920.235458:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788360920.235466:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144023296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360920.235480:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360920.235542:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144023424 00000100:00100000:1.0:1788360920.235548:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144023424 00000100:00100000:1.0:1788360920.235598:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788360920.235606:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144023424:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788360920.235673:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360920.236864:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144023296:0@lo:400:kworker.0 00000100:00100000:0.0:1788360920.236975:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144023296:12345-0@lo:400:kworker.0 Request processed in 1508us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360920.236984:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788360920.238432:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144022912:0@lo:400:kworker.0 00000100:00100000:1.0:1788360920.238434:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144023424:12345-0@lo:400:kworker.0 Request processed in 2825us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360920.238449:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788360920.238457:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144023424:0@lo:400:kworker.0 00000100:00100000:1.0:1788360920.367113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360920.367289:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130366208 00000100:00100000:2.0:1788360920.367301:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130366208 00000100:00100000:2.0:1788360920.367362:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:2.0:1788360920.367371:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:10320:x1875232130366208:12345-192.168.203.60@tcp:101:stat.0 00010000:00010000:2.0:1788360920.367393:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360920.367412:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610677 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e26f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.367561:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661067e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.367575:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661067e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.367597:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661067e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.367611:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.367618:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.367625:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.368690:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.368705:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e268 expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.368713:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.368758:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e268 expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.368773:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e268 expref: 21 pid: 5799 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360920.368786:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144023808:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360920.369689:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788360920.382535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360920.382724:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130366464 00000100:00100000:1.0:1788360920.382732:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130366464 00000100:00100000:2.0:1788360920.382748:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144023808:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360920.382775:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360920.382784:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788360920.382794:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:5560:x1875232130366464:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788360920.383134:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:5560:x1875232130366464:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 340us (607us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788360920.383141:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788360920.384738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360920.384972:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130366592 00000100:00100000:0.0:1788360920.384982:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130366592 00010000:00010000:0.0:1788360920.385017:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e268 expref: 23 pid: 5799 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360920.385059:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:0.0:1788360920.385068:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:2349:x1875232130366592:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360920.385082:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360920.385113:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e268 expref: 23 pid: 5799 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.385126:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e268 expref: 23 pid: 5799 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.385150:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610662 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e268 expref: 23 pid: 5799 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.385165:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360920.385170:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.385178:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.385186:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.385217:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788360920.385257:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360920.385267:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:2349:x1875232130366592:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 198us (532us total) trans 0 rc 0/0 00010000:00010000:1.0:1788360920.385270:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360920.385291:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000004:00200000:1.0:1788360920.385312:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788360920.385316:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360920.385351:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385364:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385374:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661067e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385381:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661067e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385392:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661067e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385398:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360920.385402:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661067e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385410:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661067e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385429:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360920.385432:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360920.385436:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661067e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385442:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661067e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385453:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385459:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610685 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385465:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385470:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360920.385473:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385487:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385495:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8aa8ee1600) 00010000:00010000:1.0:1788360920.385497:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360920.385500:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610685 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385505:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610685 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385537:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610677 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e26f expref: 22 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385550:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e26f expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.385557:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:1.0:1788360920.385559:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360920.385561:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:1.0:1788360920.385584:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:10320:x1875232130366208:12345-192.168.203.60@tcp:101:stat.0 Request processed in 18215us (18513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360920.385591:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:2.0:1788360920.438335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360920.439356:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130366848 00000100:00100000:0.0:1788360920.439369:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130366848 00000100:00100000:0.0:1788360920.439725:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:0.0:1788360920.439737:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:10326:x1875232130366848:12345-192.168.203.60@tcp:36:truncate.0 00010000:00010000:0.0:1788360920.439795:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360920.439821:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661068c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e26f expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.439840:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360920.439845:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788360920.440057:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.440072:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.440082:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788360920.440188:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788360920.440213:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd493f31 reply state 0000000067b11c8f transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360920.440221:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788360920.440337:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:10326:x1875232130366848:12345-192.168.203.60@tcp:36:truncate.0 Request processed in 602us (2012us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788360920.440344:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000020:00080000:0.0:1788360920.440360:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788360920.445004:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.445021:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.445028:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.445034:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360920.445040:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.445049:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.445068:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360920.445071:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360920.445076:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.445082:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610693 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360920.616563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360920.616860:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130366976 00000100:00100000:1.0:1788360920.616870:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130366976 00000100:00100000:1.0:1788360920.616951:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1788360920.616962:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:10340:x1875232130366976:12345-192.168.203.60@tcp:101:stat.0 00010000:00010000:1.0:1788360920.617006:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360920.617027:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d661069a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e276 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617144:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617160:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617170:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617184:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617190:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617196:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617504:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617513:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617519:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360920.617552:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788360920.617561:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360920.617581:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617607:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617614:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617620:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617626:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617631:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360920.617635:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617650:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617662:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360920.617665:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360920.617669:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617675:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617686:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617700:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.617706:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.619176:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360920.619183:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.619191:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.619206:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a99640c00) 00010000:00010000:1.0:1788360920.619209:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360920.619213:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.619220:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.619277:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d661069a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e276 expref: 24 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.619292:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e276 expref: 23 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.619300:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:1.0:1788360920.619302:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360920.619320:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a400, rc 0) 00000100:00100000:1.0:1788360920.619404:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:10340:x1875232130366976:12345-192.168.203.60@tcp:101:stat.0 Request processed in 2442us (2864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360920.619413:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1788360920.710885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360920.712422:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130367232 00000100:00100000:0.0:1788360920.712437:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130367232 00000100:00100000:0.0:1788360920.712526:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:0.0:1788360920.712537:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:10350:x1875232130367232:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360920.712568:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360920.712588:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e27d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360920.713193:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788360920.713366:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e27d expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.713382:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:0.0:1788360920.713385:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788360920.713390:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e27d expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.713404:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43e00, rc 0) 00000100:00100000:0.0:1788360920.713475:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:10350:x1875232130367232:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 939us (2600us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788360920.713482:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:3.0:1788360920.719322:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360920.722032:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130367488 00000100:00100000:1.0:1788360920.722054:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130367488 00000100:00100000:1.0:1788360920.723040:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788360920.723059:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:10350:x1875232130367488:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788360920.724968:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+25:10350:x1875232130367488:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 1900us (5654us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788360920.724984:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788360920.739137:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144023936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788360920.739254:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360920.739817:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144023936 00000100:00100000:2.0:1788360920.739831:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144023936 00000100:00100000:2.0:1788360920.739917:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788360920.739928:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144023936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788360920.740023:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788360920.740146:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144023936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 220us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360920.740154:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788360920.740665:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144023936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788360920.803008:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360920.829934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360920.830355:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130367744 00000100:00100000:1.0:1788360920.830371:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130367744 00000100:00100000:1.0:1788360920.830513:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:1.0:1788360920.830526:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+25:10356:x1875232130367744:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788360920.830559:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360920.830587:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66106c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e284 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.830732:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.830752:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e276 expref: 26 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.830762:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.831051:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e276 expref: 26 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.831068:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e276 expref: 26 pid: 6736 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360920.831111:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144024064:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788360920.831255:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a890266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360920.838887:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144024064:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360920.838935:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360920.840054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360920.840657:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130367872 00000100:00100000:0.0:1788360920.840673:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130367872 00010000:00010000:0.0:1788360920.840965:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e276 expref: 27 pid: 6736 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360920.841023:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:0.0:1788360920.841035:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:2350:x1875232130367872:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360920.841055:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360920.841063:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e276 expref: 27 pid: 6736 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.841076:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e276 expref: 27 pid: 6736 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.841152:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66106af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e276 expref: 27 pid: 6736 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.841182:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360920.841189:0:7487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.841199:0:7487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.841207:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.841246:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360920.841321:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:2350:x1875232130367872:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 289us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360920.841330:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00010000:00010000:2.0:1788360920.842450:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.842474:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360920.842505:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788360920.843397:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66106c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e284 expref: 27 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.843541:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e284 expref: 26 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.843577:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:2.0:1788360920.843635:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788360920.843640:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b800, rc 0) 00000100:00100000:2.0:1788360920.844026:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:10356:x1875232130367744:12345-192.168.203.60@tcp:101:bash.0 Request processed in 13499us (14104us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788360920.844037:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:2.0:1788360920.848050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360920.848287:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130368128 00000100:00100000:0.0:1788360920.848301:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130368128 00000100:00100000:0.0:1788360920.848441:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:0.0:1788360920.848453:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:10356:x1875232130368128:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:0.0:1788360920.848864:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.848888:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.848912:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788360920.849001:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788360920.849029:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061e1f876 reply state 000000009ea72104 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360920.849039:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788360920.849637:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:10356:x1875232130368128:12345-192.168.203.60@tcp:36:bash.0 Request processed in 1183us (1596us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788360920.849649:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000020:00080000:0.0:1788360920.849655:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788360920.854125:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.854149:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.854157:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.854165:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360920.854235:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.854246:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.854272:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360920.854275:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360920.854281:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.854287:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66106d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360920.857844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360920.858816:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130368256 00000100:00100000:1.0:1788360920.858832:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130368256 00000100:00100000:1.0:1788360920.858913:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:1.0:1788360920.858926:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:10356:x1875232130368256:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788360920.858963:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360920.858990:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e28b expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.859153:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.859171:0:6736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e284 expref: 29 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.859180:0:6736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.859239:0:6736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e284 expref: 29 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.859255:0:6736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e284 expref: 29 pid: 5799 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360920.859272:0:6736:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6736:1875232144024192:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788360920.859376:0:6736:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a890266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360920.867135:0:6736:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6736:1875232144024192:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360920.867185:0:6736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360920.867393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360920.867543:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130368384 00000100:00100000:0.0:1788360920.867552:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130368384 00010000:00010000:0.0:1788360920.867599:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e284 expref: 30 pid: 5799 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360920.867648:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1788360920.867659:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+30:2350:x1875232130368384:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360920.867678:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360920.867685:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e284 expref: 30 pid: 5799 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.867697:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e284 expref: 30 pid: 5799 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.867735:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d66106cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e284 expref: 30 pid: 5799 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.867752:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360920.867758:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.867770:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.867779:0:8303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360920.867811:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788360920.867990:0:6736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.867998:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360920.868068:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788360920.868073:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360920.868146:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.868198:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e28b expref: 30 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.868216:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e28b expref: 29 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.868239:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:1.0:1788360920.868242:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360920.868245:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a800, rc 0) 00000100:00100000:1.0:1788360920.868319:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:10356:x1875232130368256:12345-192.168.203.60@tcp:101:bash.0 Request processed in 9395us (10500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360920.868328:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:0.0:1788360920.868560:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:2350:x1875232130368384:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 901us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360920.868569:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:3.0:1788360920.875045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360920.875191:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130368640 00000100:00100000:2.0:1788360920.875205:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130368640 00000100:00100000:2.0:1788360920.875283:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788360920.875294:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f88450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:10356:x1875232130368640:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1788360920.875795:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f88450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:10356:x1875232130368640:12345-192.168.203.60@tcp:35:bash.0 Request processed in 501us (763us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788360920.875805:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788360920.956656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360920.957900:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130368896 00000100:00100000:1.0:1788360920.957932:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130368896 00000100:00100000:1.0:1788360920.958029:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:1.0:1788360920.958041:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:10366:x1875232130368896:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360920.958117:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360920.958150:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e292 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360920.958556:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1788360920.958785:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e292 expref: 31 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.958802:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:1.0:1788360920.958806:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788360920.958812:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66106ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e292 expref: 31 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360920.958829:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705ac00, rc 0) 00000100:00100000:1.0:1788360920.958933:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+30:10366:x1875232130368896:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 894us (2293us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1788360920.958953:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:3.0:1788360920.967260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360920.968868:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130369024 00000100:00100000:2.0:1788360920.968888:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130369024 00000100:00100000:2.0:1788360920.968986:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:2.0:1788360920.968998:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+30:10366:x1875232130369024:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788360920.969121:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66106fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.969144:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66106fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.969160:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66106fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.969198:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.969207:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.969215:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970032:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970051:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970061:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360920.970164:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970182:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66106fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970189:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66106fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970197:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66106fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970204:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360920.970209:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66106fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970227:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66106fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970244:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:2.0:1788360920.970247:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360920.970254:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66106fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970261:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66106fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970278:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970284:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610703 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970290:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970296:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360920.970299:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970304:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610703 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970311:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8aa8ee1e00) 00010000:00010000:2.0:1788360920.970313:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360920.970316:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610703 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970404:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610703 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970422:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970428:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970434:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970439:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360920.970443:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970448:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970521:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:2.0:1788360920.970525:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360920.970528:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360920.970534:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661070a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360920.970739:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+30:10366:x1875232130369024:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1737us (3492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360920.970759:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:3.0:1788360920.973429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360920.973522:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130369280 00000100:00100000:0.0:1788360920.973536:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130369280 00000100:00100000:0.0:1788360920.973612:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788360920.973623:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+30:10366:x1875232130369280:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788360920.974670:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+31:10366:x1875232130369280:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 1039us (1254us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788360920.974683:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1788360921.033030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.033494:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130369536 00000100:00100000:0.0:1788360921.033509:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130369536 00000100:00100000:0.0:1788360921.033706:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1788360921.033718:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+31:10369:x1875232130369536:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360921.033751:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360921.033778:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610711 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e299 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.033872:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610718 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.033890:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.033916:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.033933:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661071f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.033959:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661071f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.033967:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661071f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.034729:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.034745:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.034754:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360921.034767:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788360921.034893:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.034914:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610718 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.034923:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610718 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.034929:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360921.034934:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610718 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.034942:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610718 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.034970:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:0.0:1788360921.034973:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360921.034979:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610718 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.034985:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610718 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.035001:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661071f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.035008:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661071f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.035014:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661071f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.035019:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360921.035022:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661071f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.035029:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661071f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.035037:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a983bf600) 00010000:00010000:0.0:1788360921.035039:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360921.035042:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661071f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.035048:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661071f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.035177:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610711 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e299 expref: 34 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.035194:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e299 expref: 33 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.035215:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360921.035217:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788360921.035220:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42800, rc 0) 00000100:00080000:3.0:1788360921.036064:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360921.036430:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+33:10369:x1875232130369536:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 2703us (3404us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788360921.036444:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:2.0:1788360921.042051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360921.042126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.042222:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130369664 00000100:00100000:1.0:1788360921.042235:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130369664 00000100:00100000:1.0:1788360921.042325:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:1.0:1788360921.042343:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+33:10369:x1875232130369664:12345-192.168.203.60@tcp:54:lfs.0 00000100:00100000:0.0:1788360921.042365:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130369792 00000100:00100000:0.0:1788360921.042378:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130369792 00000100:00100000:0.0:1788360921.042423:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788360921.042433:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:2350:x1875232130369792:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360921.042440:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.042449:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360921.042467:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.042484:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.042887:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e299 expref: 34 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.042916:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788360921.042923:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360921.042999:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+33:2350:x1875232130369792:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 568us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360921.043008:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00010000:00010000:1.0:1788360921.045767:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.045786:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610734 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.045793:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.045799:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705bc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360921.045805:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.045815:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.045833:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:1.0:1788360921.045854:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788360921.045860:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610734 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.045866:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360921.046013:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:10369:x1875232130369664:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 3673us (3970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360921.046037:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:3.0:1788360921.049317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.049433:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130370048 00000100:00100000:1.0:1788360921.049449:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130370048 00000100:00100000:1.0:1788360921.049592:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788360921.049603:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:10369:x1875232130370048:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788360921.051215:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+33:10369:x1875232130370048:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 1598us (1899us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788360921.051231:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1788360921.223235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.223362:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130370304 00000100:00100000:1.0:1788360921.223376:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130370304 00000100:00100000:1.0:1788360921.223457:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1788360921.223470:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+33:10387:x1875232130370304:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:1.0:1788360921.223503:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360921.223532:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661073b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2a0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.223850:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610742 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.223870:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610742 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.223916:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610742 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360921.223933:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788360921.224224:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661073b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2a0 expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.224262:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610742 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2a0 expref: 35 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.224272:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:1.0:1788360921.224275:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788360921.224280:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a000, rc 0) 00000100:00100000:1.0:1788360921.224360:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:10387:x1875232130370304:12345-192.168.203.60@tcp:101:cat.0 Request processed in 892us (1141us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788360921.224370:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:3.0:1788360921.252437:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360921.252612:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130370432 00000100:00100000:2.0:1788360921.252625:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130370432 00000100:00100000:2.0:1788360921.252708:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1788360921.252719:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:10388:x1875232130370432:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360921.252754:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360921.252782:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2a7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.252874:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610757 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.252892:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.252919:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360921.254449:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788360921.254463:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360921.254649:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.254708:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2a7 expref: 37 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.254734:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2a7 expref: 36 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.254761:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:2.0:1788360921.254764:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788360921.254769:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:2.0:1788360921.254897:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10388:x1875232130370432:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 2177us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360921.254917:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1788360921.262500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.262777:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130370816 00000100:00100000:0.0:1788360921.262791:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130370816 00000100:00100000:0.0:1788360921.262942:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1788360921.262956:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10388:x1875232130370816:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788360921.263501:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:10388:x1875232130370816:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 546us (1014us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788360921.263511:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788360921.267195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.267319:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130370944 00000100:00100000:1.0:1788360921.267333:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130370944 00000100:00100000:1.0:1788360921.267417:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788360921.267430:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:10388:x1875232130370944:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:1.0:1788360921.267452:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788360921.267488:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d66106e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e28b expref: 37 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.267516:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610742 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2a0 expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.267557:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66105eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e24c expref: 35 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.267568:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:1.0:1788360921.267584:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360921.267664:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:10388:x1875232130370944:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 237us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360921.267673:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788360921.270261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.273506:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130371072 00000100:00100000:1.0:1788360921.273522:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130371072 00000100:00100000:1.0:1788360921.275365:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:1.0:1788360921.275388:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:10388:x1875232130371072:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:1.0:1788360921.275508:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d661075e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.275524:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d661075e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.275535:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d661075e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788360921.276460:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788360921.276641:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788360921.276705:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788360921.277002:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:10388:x1875232130371072:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 1620us (6751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360921.277012:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:2.0:1788360921.300340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.303175:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130371200 00000100:00100000:1.0:1788360921.303195:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130371200 00000100:00100000:1.0:1788360921.303283:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:1.0:1788360921.303293:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:10390:x1875232130371200:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360921.303318:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360921.303346:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610765 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2ae expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.303423:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661076c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.303439:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661076c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.303450:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661076c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.303465:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.303624:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.303634:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306213:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306236:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306265:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360921.306317:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788360921.306322:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360921.306346:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306358:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306367:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661076c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306373:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661076c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306380:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661076c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306386:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705bc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360921.306390:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661076c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306398:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661076c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306410:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360921.306413:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360921.306417:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661076c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306432:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661076c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306444:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306450:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610773 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306455:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306460:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360921.306463:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306469:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610773 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306477:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a99640900) 00010000:00010000:1.0:1788360921.306480:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360921.306482:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610773 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.306489:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610773 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.307053:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610765 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ae expref: 36 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.307068:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ae expref: 35 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.307787:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360921.307795:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788360921.307799:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b800, rc 0) 00000100:00100000:1.0:1788360921.308325:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:10390:x1875232130371200:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 5027us (7991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360921.308335:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:0.0:1788360921.740655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.740700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.740724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.740746:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.740781:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130371584 00000100:00100000:0.0:1788360921.740791:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130371584 00000100:00100000:0.0:1788360921.740850:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:0.0:1788360921.740859:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2351:x1875232130371584:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360921.740940:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2351:x1875232130371584:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360921.740948:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:0.0:1788360921.740971:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130371456 00000100:00100000:0.0:1788360921.740974:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130371456 00000100:00100000:0.0:1788360921.740995:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130371712 00000100:00100000:0.0:1788360921.740997:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130371712 00000100:00100000:0.0:1788360921.741018:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:0.0:1788360921.741024:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:2351:x1875232130371456:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360921.741052:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:2351:x1875232130371456:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360921.741067:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:0.0:1788360921.741080:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:0.0:1788360921.741109:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2351:x1875232130371712:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360921.741139:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2351:x1875232130371712:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 53us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360921.741145:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:2.0:1788360921.741248:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130371328 00000100:00100000:2.0:1788360921.741252:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130371328 00000100:00100000:2.0:1788360921.741287:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 274 00000100:00100000:2.0:1788360921.741293:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2351:x1875232130371328:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360921.741319:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2351:x1875232130371328:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360921.741325:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 274 00000100:00080000:3.0:1788360921.742061:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788360921.742067:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788360921.761304:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788360921.761315:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788360921.761366:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788360921.761376:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788360921.761516:0:11534:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84854e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144024320:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788360921.761617:0:11534:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abc9af240 going to sleep for 11 seconds 00000100:00100000:0.0:1788360921.767146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360921.767449:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130371840 00000100:00100000:3.0:1788360921.767460:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130371840 00000100:00100000:3.0:1788360921.767537:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788360921.767550:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10401:x1875232130371840:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788360921.767637:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10401:x1875232130371840:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 Request processed in 91us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360921.767644:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:1.0:1788360921.768668:0:11534:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84854e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144024320:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788360921.769783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.769969:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130371968 00000100:00100000:0.0:1788360921.769978:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130371968 00000100:00100000:0.0:1788360921.770059:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:0.0:1788360921.770069:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:10401:x1875232130371968:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788360921.770125:0:5798:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788360921.770237:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:10401:x1875232130371968:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 168us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360921.770244:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:0.0:1788360921.774515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.774594:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130372096 00000100:00100000:1.0:1788360921.774604:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130372096 00000100:00100000:1.0:1788360921.774668:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:1.0:1788360921.774681:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:10401:x1875232130372096:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788360921.774755:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610781 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.774773:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610781 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.774786:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610781 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.774859:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610788 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.774868:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.774875:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.774921:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.774931:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.774939:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360921.774976:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788360921.774980:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360921.774995:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775006:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610781 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775012:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610781 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775019:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610781 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775025:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360921.775029:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610781 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775037:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610781 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775048:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:1.0:1788360921.775060:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360921.775065:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610781 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775072:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610781 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775110:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610788 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775117:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610788 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775122:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610788 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775126:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360921.775129:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610788 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775134:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610788 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775142:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9a8a99640900) 00010000:00010000:1.0:1788360921.775144:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360921.775146:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610788 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775151:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610788 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775165:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775178:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775183:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775188:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360921.775191:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775197:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775206:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360921.775208:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360921.775211:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.775216:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d661078f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360921.775295:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:10401:x1875232130372096:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 616us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360921.775304:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:3.0:1788360921.779462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.779534:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130372352 00000100:00100000:0.0:1788360921.779544:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130372352 00000100:00100000:0.0:1788360921.779604:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:0.0:1788360921.779625:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:10401:x1875232130372352:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788360921.779647:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360921.779666:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610796 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2b5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.779771:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661079d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.779786:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661079d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.779810:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661079d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360921.779823:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788360921.779941:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661079d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.779949:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661079d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.779955:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661079d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.779961:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360921.779964:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661079d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.779971:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661079d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.779982:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:0.0:1788360921.779989:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788360921.779994:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661079d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.780003:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661079d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.780039:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610796 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2b5 expref: 37 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.780048:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:0.0:1788360921.780050:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788360921.780053:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610796 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2b5 expref: 37 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.780061:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43400, rc 0) 00000100:00100000:0.0:1788360921.780140:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10401:x1875232130372352:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 517us (687us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788360921.780148:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:0.0:1788360921.786456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.786518:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130372480 00000100:00100000:1.0:1788360921.786529:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130372480 00000100:00100000:1.0:1788360921.786612:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:1.0:1788360921.786625:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10401:x1875232130372480:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788360921.786663:0:6736:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788360921.787346:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10401:x1875232130372480:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 722us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360921.787357:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:0.0:1788360921.795732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360921.795875:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130372736 00000100:00100000:3.0:1788360921.795886:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130372736 00000100:00100000:3.0:1788360921.798052:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:3.0:1788360921.798073:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10401:x1875232130372736:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788360921.798113:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360921.798117:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788360921.798145:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610757 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2a7 expref: 36 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.798171:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:3.0:1788360921.798176:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360921.798190:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66107ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2bc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788360921.799272:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788360921.799555:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66107b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.799571:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66107b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.799583:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66107b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.799647:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66107ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2bc expref: 38 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.799665:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66107b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2bc expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.799676:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:3.0:1788360921.799679:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788360921.799682:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f400, rc 0) 00000100:00100000:3.0:1788360921.799806:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:10401:x1875232130372736:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1740us (4081us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788360921.799815:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:3.0:1788360921.803516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.803615:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130372992 00000100:00100000:0.0:1788360921.803627:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130372992 00000100:00100000:0.0:1788360921.803692:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788360921.803702:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:10401:x1875232130372992:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788360921.803758:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360921.803783:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66107b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2bc expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.803811:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:0.0:1788360921.803819:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788360921.803839:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66107c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.803850:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66107c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.803860:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66107c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.804490:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66107c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc067baca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.804502:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66107c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc067baca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.804510:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66107c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc067baca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.804764:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66107c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.804772:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66107c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.804778:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66107c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.804784:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360921.804788:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66107c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.804980:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66107c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.804991:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:0.0:1788360921.804993:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360921.804997:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66107c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.805002:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66107c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.805011:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66107c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc067baca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.805016:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66107c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc067baca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.805021:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66107c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc067baca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.805026:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360921.805028:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66107c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc067baca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.805034:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66107c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc067baca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.805041:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc067baca (ffff9a8a983bf600) 00010000:00010000:0.0:1788360921.805043:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360921.805046:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66107c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc067baca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.805061:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66107c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc067baca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360921.805351:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10401:x1875232130372992:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1648us (1837us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788360921.805359:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788360921.807021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.807111:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130373120 00000100:00100000:1.0:1788360921.807120:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130373120 00000100:00100000:1.0:1788360921.807262:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:1.0:1788360921.807381:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10401:x1875232130373120:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788360921.807402:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360921.807436:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2c3 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.807469:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.807481:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.807493:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.807585:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2c3 expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.807596:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2c3 expref: 37 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.807602:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a99640900) 00010000:00010000:1.0:1788360921.807603:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788360921.807606:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a200, rc 0) 00000100:00100000:1.0:1788360921.807794:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:10401:x1875232130373120:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 415us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360921.807802:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:0.0:1788360921.811133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.811234:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130373376 00000100:00100000:1.0:1788360921.811244:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130373376 00000100:00100000:1.0:1788360921.811297:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:1.0:1788360921.811307:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:10401:x1875232130373376:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788360921.811389:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.811406:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.811418:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788360921.811700:0:6736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788360921.811710:0:6736:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311826623550ns, next at 312826621352ns, rc = 0 00000004:00010000:1.0:1788360921.811792:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3f1e99a reply state 00000000581276cf transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360921.811802:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788360921.811912:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+39:10401:x1875232130373376:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 606us (788us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788360921.811920:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00010000:00010000:0.0:1788360921.813034:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.813046:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.813053:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.813059:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360921.813064:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.813072:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.813118:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a99640900) 00010000:00010000:0.0:1788360921.813122:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788360921.813127:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.813133:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66107dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360921.814017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360921.814114:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130373504 00000100:00100000:3.0:1788360921.814125:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130373504 00000100:00100000:1.0:1788360921.814234:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:1.0:1788360921.814244:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+38:10401:x1875232130373504:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788360921.814266:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360921.814294:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2ca expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.814354:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ca expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.814367:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ca expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360921.814386:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a99640900) 00010000:00010000:1.0:1788360921.814389:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788360921.814392:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b200, rc 0) 00000100:00100000:1.0:1788360921.814454:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+39:10401:x1875232130373504:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 211us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360921.814461:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1788360921.816868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.816932:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130373632 00000100:00100000:0.0:1788360921.816941:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130373632 00000100:00100000:0.0:1788360921.816986:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:0.0:1788360921.816993:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875232130373632:12345-192.168.203.60@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788360921.817024:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:0.0:1788360921.817058:0:6592:0:(genops.c:1406:class_connect()) connect: client 11e5d128-044a-45c3-b501-2dba6e5a82fa, cookie 0xf6a94c97d66107ea 00002000:00100000:0.0:1788360921.817071:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11e5d128-044a-45c3-b501-2dba6e5a82fa/ffff9a8abccc6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788360921.817081:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788360921.817383:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788360921.817409:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a8abccc3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788360921.817516:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2348:x1875232130373632:12345-192.168.203.60@tcp:8:lhsmtool_posix.0 Request processed in 521us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360921.817524:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:2.0:1788360921.819543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360921.819642:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130373760 00000100:00100000:0.0:1788360921.819651:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130373760 00000100:00100000:0.0:1788360921.819723:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788360921.819732:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:0:x1875232130373760:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788360921.819751:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788360921.824336:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788360921.872005:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1788360921.872023:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000100:00100000:0.0:1788360921.873340:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:0:x1875232130373760:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 53598us (53802us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788360921.873354:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1788360921.876016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360921.884560:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130374016 00000100:00100000:3.0:1788360921.884574:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130374016 00000100:00100000:3.0:1788360921.884656:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788360921.884667:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+39:10401:x1875232130374016:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788360921.884906:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+40:10401:x1875232130374016:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 231us (8888us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788360921.884915:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788360921.893186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360921.893228:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130374272 00000100:00100000:3.0:1788360921.893238:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130374272 00000100:00100000:3.0:1788360921.893289:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:3.0:1788360921.893299:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+40:10401:x1875232130374272:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788360921.893404:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+40:10401:x1875232130374272:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 107us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360921.893411:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:2.0:1788360921.901828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360921.901958:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130374400 00000100:00100000:3.0:1788360921.901968:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130374400 00000100:00100000:3.0:1788360921.902022:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:3.0:1788360921.902032:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+40:10401:x1875232130374400:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788360921.902055:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360921.902075:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66107f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2d1 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.902573:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66107f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.902589:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66107f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.902601:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66107f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360921.902638:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788360921.902656:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66107f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.902684:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66107f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d1 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.902698:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66107f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d1 expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.902706:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a99640900) 00010000:00010000:3.0:1788360921.902709:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788360921.902713:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ec00, rc 0) 00000100:00100000:3.0:1788360921.902768:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:10401:x1875232130374400:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 737us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360921.902776:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:3.0:1788360921.908613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360921.914494:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130374528 00000100:00100000:2.0:1788360921.914508:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130374528 00000100:00100000:3.0:1788360921.914625:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788360921.914636:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130374528:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788360921.914660:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360921.914681:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d66107ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2d8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788360921.914706:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9838da, blocks: 0x1 00010000:00010000:3.0:1788360921.914726:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:3.0:1788360921.914731:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788360921.914739:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d66107ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d8 expref: 6 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.914759:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d66107ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d8 expref: 6 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.914771:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:3.0:1788360921.914843:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130374528:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 209us (6239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360921.914850:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788360921.920480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360921.920512:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130374784 00000100:00100000:3.0:1788360921.920520:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130374784 00000100:00100000:3.0:1788360921.920567:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:3.0:1788360921.920576:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:10401:x1875232130374784:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788360921.920670:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:10401:x1875232130374784:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360921.920678:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:2.0:1788360921.928981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.932422:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130374912 00000100:00100000:1.0:1788360921.932439:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130374912 00000100:00100000:0.0:1788360921.932685:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788360921.932704:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:10401:x1875232130374912:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788360921.932724:0:9606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360921.932743:0:9606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2df expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.932777:0:9606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d66107ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d8 expref: 7 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.932786:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360921.932790:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360921.932795:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 7 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.932830:0:9606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d66107ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d8 expref: 7 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360921.932844:0:9606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d66107ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d8 expref: 7 pid: 6592 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360921.932859:0:9606:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144024448:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360921.932975:0:9606:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49000 going to sleep for 11 seconds 00000100:00100000:3.0:1788360921.940934:0:9606:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc431500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144024448:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360921.940971:0:9606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 7 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360921.940993:0:9606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43600, rc 0) 00000100:00100000:1.0:1788360921.941197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360921.941936:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:10401:x1875232130374912:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 9231us (12962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360921.941945:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:2.0:1788360921.943982:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130375040 00000100:00100000:2.0:1788360921.943994:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130375040 00010000:00010000:2.0:1788360921.944036:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d66107ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d8 expref: 7 pid: 6592 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360921.944114:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:2.0:1788360921.944125:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130375040:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360921.944141:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360921.944165:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d66107ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d8 expref: 7 pid: 6592 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.944180:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d66107ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d8 expref: 7 pid: 6592 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.944203:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d66107ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d8 expref: 7 pid: 6592 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.944217:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360921.944221:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360921.944229:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 6 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.944238:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 6 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360921.944273:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 6 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360921.944287:0:5783:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a60e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1875232144024576:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788360921.944371:0:5783:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a5cfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360921.949513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360921.949615:0:5783:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a60e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1875232144024576:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788360921.949638:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360921.949691:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130375040:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 5567us (8494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360921.949702:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:0.0:1788360921.951453:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130375168 00000100:00100000:0.0:1788360921.951469:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130375168 00002000:00100000:0.0:1788360921.951518:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a8986704000 x1875232130375168/t0(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:737/0 lens 504/0 e 0 to 0 dl 1788360932 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788360921.951529:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986704000 with x1875232130375168 ext(0->8) 00002000:00010000:0.0:1788360921.951542:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8986704000 00000100:00100000:0.0:1788360921.951572:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788360921.951583:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130375168:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788360921.952225:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2349:x1875232130375168:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 642us (2718us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788360921.952234:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:0.0:1788360921.952242:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a8986704000 x1875232130375168/t4294967302(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:737/0 lens 504/448 e 0 to 0 dl 1788360932 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788360921.952250:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986704000 with x1875232130375168 ext(0->8) 00002000:00010000:0.0:1788360921.952254:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8986704000 00000100:00100000:2.0:1788360921.960764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360921.960818:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130375296 00000100:00100000:3.0:1788360921.960828:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130375296 00000100:00100000:3.0:1788360921.960882:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:3.0:1788360921.960891:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:10401:x1875232130375296:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1788360921.998995:0:11853:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788360921.999006:0:11853:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788360921.999046:0:11853:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788360921.999052:0:11853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788360922.011255:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:10401:x1875232130375296:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 50356us (50492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360922.011269:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000001:00080000:2.0:1788360922.011959:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000020:00080000:2.0:1788360922.011996:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1788360922.012016:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1788360922.012022:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788360922.012053:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1788360922.012127:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788360922.012138:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788360922.014512:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144024704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788360922.014579:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360922.014664:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144024704 00000100:00100000:1.0:1788360922.014672:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144024704 00000100:00100000:1.0:1788360922.014727:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788360922.014735:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144024704:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788360922.014777:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788360922.014888:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788360922.014915:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788360922 00002000:00010000:1.0:1788360922.014917:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788360922.014920:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788360922 -> 1788360922 00002000:00010000:1.0:1788360922.014922:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788360922.017525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360922.020317:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144024704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5571us (5726us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788360922.020333:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788360922.020360:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130375424 00000100:00100000:1.0:1788360922.020370:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130375424 00000100:00100000:1.0:1788360922.020412:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788360922.020420:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130375424:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1788360922.023324:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8986706d80/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788360922.023340:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144024704:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1788360922.049049:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1788360922.049072:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788360922.051345:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130375424:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 30914us (33815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360922.051358:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:3.0:1788360922.053524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360922.053668:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130375680 00000100:00100000:0.0:1788360922.053677:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130375680 00000100:00100000:0.0:1788360922.053760:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:0.0:1788360922.053771:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:10401:x1875232130375680:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788360922.053823:0:6736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360922.053855:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66107f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2d1 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.053871:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a99640900) 00010000:00010000:0.0:1788360922.053875:0:6736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788360922.053910:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.053923:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.053932:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788360922.054511:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086108305 reply state 00000000fa633adb transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360922.054523:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788360922.054610:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:10401:x1875232130375680:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 840us (1092us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788360922.054618:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788360922.063068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360922.063132:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130375808 00000100:00100000:1.0:1788360922.063143:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130375808 00010000:00010000:0.0:1788360922.063178:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360922.063190:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00010000:00010000:0.0:1788360922.063192:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360922.063202:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130375808:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1788360922.063216:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.063224:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360922.063229:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.063239:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.063256:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a99640900) 00010000:00010000:0.0:1788360922.063260:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360922.063264:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.063271:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661080d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788360922.063474:0:6594:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788360922.063478:0:6594:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788360922 -> 1788360921 00002000:00010000:1.0:1788360922.063494:0:6594:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788360920 00002000:00010000:1.0:1788360922.063497:0:6594:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788360922 -> 1788360921 00002000:00010000:1.0:1788360922.063499:0:6594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788360922.063562:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130375808:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 362us (501us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788360922.063570:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788360922.068471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360922.069138:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130376064 00000100:00100000:1.0:1788360922.069149:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130376064 00000100:00100000:1.0:1788360922.069213:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:1.0:1788360922.069222:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:10401:x1875232130376064:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788360922.069287:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360922.069304:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2c3 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360922.069314:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360922.069348:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2c3 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360922.069363:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2c3 expref: 13 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360922.069377:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbd2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144024832:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788360922.069465:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788360922.077270:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbd2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144024832:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360922.077310:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360922.077796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360922.077851:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130376192 00000100:00100000:3.0:1788360922.077858:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130376192 00010000:00010000:3.0:1788360922.077910:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2c3 expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360922.077951:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1788360922.077960:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:2349:x1875232130376192:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360922.077983:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360922.077991:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2c3 expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078008:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2c3 expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078029:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66107d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2c3 expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078043:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a99640900) 00010000:00010000:3.0:1788360922.078047:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078057:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078064:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078107:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360922.078164:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:2349:x1875232130376192:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 203us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360922.078171:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00010000:00010000:3.0:1788360922.078205:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078212:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078250:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078256:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078263:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078268:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360922.078272:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078280:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078288:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a99640900) 00010000:00010000:3.0:1788360922.078290:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788360922.078294:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.078299:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610814 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360922.078337:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:10401:x1875232130376064:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 9116us (9874us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788360922.078345:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:2.0:1788360922.080713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360922.080824:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130376320 00000100:00100000:3.0:1788360922.080841:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130376320 00000100:00100000:3.0:1788360922.080913:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:3.0:1788360922.080933:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130376320:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788360922.080976:0:9606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.080992:0:9606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 7 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.080999:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788360922.081002:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788360922.081005:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.081034:0:9606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 7 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.081339:0:9606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 7 pid: 9606 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360922.081356:0:9606:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144024960:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788360922.083098:0:9606:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bada600 going to sleep for 11 seconds 00000100:00100000:0.0:1788360922.087502:0:9606:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144024960:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360922.087540:0:9606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360922.088259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360922.089827:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130376448 00000100:00100000:0.0:1788360922.089838:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130376448 00010000:00010000:0.0:1788360922.089878:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 8 pid: 9606 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360922.089936:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1788360922.089956:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130376448:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360922.089973:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360922.089996:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 8 pid: 9606 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.090012:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 8 pid: 9606 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.090039:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610806 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2df expref: 8 pid: 9606 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.090056:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788360922.090061:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788360922.090067:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.090077:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.090130:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360922.090188:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130376448:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 235us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360922.090197:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00010000:00010000:3.0:1788360922.091933:0:9606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.091949:0:9606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.091999:0:9606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.092007:0:9606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.092016:0:9606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.092024:0:9606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788360922.092028:0:9606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.092037:0:9606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.092055:0:9606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.092062:0:9606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a54fa4/0xf6a94c97d661081b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360922.092174:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130376320:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 11241us (11467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360922.092182:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:2.0:1788360922.110766:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360922.110973:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130376704 00000100:00100000:3.0:1788360922.110982:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130376704 00000100:00100000:3.0:1788360922.111045:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1788360922.111054:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:10401:x1875232130376704:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788360922.111148:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610822 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.111563:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.111578:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.111778:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.111791:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ca expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.111799:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.112590:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ca expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.112609:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ca expref: 13 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360922.112626:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144025088:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788360922.112716:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8badac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788360922.117502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360922.117536:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130376832 00000100:00100000:1.0:1788360922.117545:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130376832 00010000:00010000:1.0:1788360922.117581:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107e3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ca expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360922.117719:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144025088:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360922.117753:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360922.117838:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:1.0:1788360922.117850:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:2349:x1875232130376832:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360922.117873:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360922.117881:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ca expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360922.117902:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ca expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360922.117924:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66107e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ca expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360922.117937:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a99640900) 00010000:00010000:1.0:1788360922.117941:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360922.117950:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360922.117957:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360922.118019:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360922.118071:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:2349:x1875232130376832:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 223us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360922.118080:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00010000:00010000:2.0:1788360922.118204:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.118212:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788360922.118392:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788360922.118531:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788360922.118574:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788360922.119008:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5799:1875232144025216:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788360922.119055:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360922.119115:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788360922.119198:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144025216 00000100:00100000:0.0:1788360922.119205:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144025216 00000100:00100000:0.0:1788360922.119251:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788360922.119259:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1875232144025216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788360922.119332:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1875232144025216:12345-0@lo:1000:mdt00_002.0 Request processed in 74us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360922.119340:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788360922.119374:0:5799:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788360922.119380:0:5799:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8986706d80, transno 4294967303 00000100:00100000:0.0:1788360922.119392:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5799:1875232144025216:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788360922.119824:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788360922.119885:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5799:1875232144025344:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788360922.119941:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360922.119960:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788360922.119974:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144025344 00000100:00100000:0.0:1788360922.119978:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144025344 00000100:00100000:0.0:1788360922.119998:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788360922.120004:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1875232144025344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788360922.120182:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5799:x1875232144025344:12345-0@lo:1000:mdt00_002.0 Request processed in 177us (240us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788360922.120190:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788360922.120224:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5799:1875232144025344:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788360922.120255:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120265:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120272:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120278:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360922.120288:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120297:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120313:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a99640900) 00010000:00010000:0.0:1788360922.120316:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788360922.120321:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120327:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610829 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120362:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d661075e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120368:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d661075e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120374:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d661075e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120379:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360922.120382:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d661075e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120387:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d661075e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120393:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:0.0:1788360922.120396:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788360922.120406:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d661075e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120412:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d661075e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120435:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120449:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ae expref: 16 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120458:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120481:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ae expref: 16 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.120495:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ae expref: 16 pid: 6736 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360922.120506:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144025472:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360922.120557:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a890266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360922.126789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360922.126842:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130376960 00000100:00100000:3.0:1788360922.126852:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130376960 00000100:00100000:0.0:1788360922.126872:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144025472:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360922.126908:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ae expref: 17 pid: 6736 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.126908:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360922.126945:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:3.0:1788360922.126954:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:2350:x1875232130376960:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360922.126970:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360922.126978:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ae expref: 17 pid: 6736 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.126990:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ae expref: 17 pid: 6736 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.127011:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d661077a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ae expref: 17 pid: 6736 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.127025:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:3.0:1788360922.127030:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.127040:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.127048:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.127078:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788360922.127119:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127125:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127136:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127143:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360922.127148:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:2350:x1875232130376960:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 195us (369us total) trans 0 rc 0/0 00010000:00010000:2.0:1788360922.127149:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127155:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360922.127171:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127179:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127189:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360922.127201:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360922.127205:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127210:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610830 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127222:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127240:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610822 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127246:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610822 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127251:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360922.127254:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610822 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127260:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610822 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127269:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360922.127271:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788360922.127274:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610822 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360922.127280:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610822 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360922.127490:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:10401:x1875232130376704:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 16437us (16730us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788360922.127500:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000020:00080000:2.0:1788360922.127505:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788360922.127932:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788360922.127937:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788360922.127983:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788360922.127990:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788360922.133433:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1788360922.133804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360922.136521:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130377216 00000100:00100000:3.0:1788360922.136537:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130377216 00000100:00100000:3.0:1788360922.136606:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1788360922.136618:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:10401:x1875232130377216:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788360922.138439:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788360922.138552:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788360922.138601:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.138620:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.138632:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.138641:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.138647:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.138654:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360922.138679:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788360922.138784:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:10401:x1875232130377216:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 2163us (4976us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788360922.138794:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000020:00080000:3.0:1788360922.138805:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788360922.139458:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788360922.139467:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.139482:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788360922.139485:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.139494:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.139507:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:0.0:1788360922.139510:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788360922.139515:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.139521:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610837 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360922.139537:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360922.139539:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360922.139541:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360922.848355:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788360923.808773:0:11906:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788360923.808784:0:11906:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788360923.808824:0:11906:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788360923.808830:0:11906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788360923.877165:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360923.897573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360923.897690:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130377472 00000100:00100000:1.0:1788360923.897707:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130377472 00000100:00100000:1.0:1788360923.897776:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:1.0:1788360923.897787:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:10419:x1875232130377472:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360923.897811:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360923.897830:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d661083e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2e6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360923.898108:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b400/0xf6a94c97d6610845 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360923.898124:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b400/0xf6a94c97d6610845 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360923.898135:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b400/0xf6a94c97d6610845 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360923.898146:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1788360923.898314:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d661083e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2e6 expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360923.898332:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b400/0xf6a94c97d6610845 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2e6 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360923.898340:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360923.898343:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788360923.898346:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b400, rc 0) 00000100:00100000:1.0:1788360923.898405:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:10419:x1875232130377472:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 620us (841us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788360923.898412:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00080000:3.0:1788360923.898495:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360923.903004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360923.903107:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130377600 00000100:00100000:0.0:1788360923.903119:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130377600 00000100:00100000:0.0:1788360923.903186:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:0.0:1788360923.903199:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:10419:x1875232130377600:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1788360923.903287:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610853 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.903306:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.903319:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.903352:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d661085a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.903360:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d661085a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.903367:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d661085a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.903939:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.903949:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.903957:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788360923.903996:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904008:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610853 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904013:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610853 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904020:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904025:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360923.904029:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904043:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610853 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904055:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:0.0:1788360923.904058:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360923.904062:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610853 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904068:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610853 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904080:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d661085a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904627:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d661085a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904634:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d661085a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904640:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360923.904644:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d661085a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904652:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d661085a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904664:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a983bff00) 00010000:00010000:0.0:1788360923.904667:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360923.904670:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d661085a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904686:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d661085a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904707:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904713:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904720:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904725:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360923.904727:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904733:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904741:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a983bf600) 00010000:00010000:0.0:1788360923.904743:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360923.904746:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360923.904752:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610861 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360923.905936:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:10419:x1875232130377600:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 2731us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360923.905947:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:0.0:1788360923.959175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360923.961977:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130377856 00000100:00100000:3.0:1788360923.961993:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130377856 00000100:00100000:3.0:1788360923.962059:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788360923.962069:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:10422:x1875232130377856:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360923.962108:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360923.962134:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610868 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2ed expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.962216:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661086f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.962231:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661086f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.962242:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661086f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.962256:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.962264:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.962270:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.962590:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.965950:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.965969:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360923.965989:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788360923.966138:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661086f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966147:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661086f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966154:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661086f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966160:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360923.966165:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661086f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966173:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661086f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966185:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:3.0:1788360923.966189:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360923.966194:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661086f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966200:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661086f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966212:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966231:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610876 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966237:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966242:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360923.966245:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966251:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966260:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a83c0b000) 00010000:00010000:3.0:1788360923.966262:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360923.966265:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610876 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966270:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966324:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ed expref: 22 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966338:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ed expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360923.966346:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:3.0:1788360923.966348:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788360923.966357:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f400, rc 0) 00000100:00100000:3.0:1788360923.966427:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:10422:x1875232130377856:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 4358us (7262us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788360923.966436:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788360923.974208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360923.974293:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130377984 00000100:00100000:2.0:1788360923.974304:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130377984 00000100:00100000:2.0:1788360923.974360:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:2.0:1788360923.974371:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:10422:x1875232130377984:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:2.0:1788360923.974500:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661088b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360923.974518:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661088b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360923.974529:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661088b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360923.974803:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661088b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360923.974811:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661088b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360923.974817:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661088b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360923.974822:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360923.974825:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661088b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360923.974831:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661088b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360923.974844:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788360923.974847:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788360923.974852:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661088b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360923.974869:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661088b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360923.974987:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:10422:x1875232130377984:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 617us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360923.974995:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:3.0:1788360923.977208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360923.977255:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130378240 00000100:00100000:0.0:1788360923.977265:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130378240 00000100:00100000:0.0:1788360923.977322:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788360923.977332:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84f8a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:10422:x1875232130378240:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788360923.977627:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84f8a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:10422:x1875232130378240:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 296us (425us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788360923.977634:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788360924.012189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.012251:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130378496 00000100:00100000:3.0:1788360924.012260:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130378496 00000100:00100000:3.0:1788360924.012323:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:3.0:1788360924.012334:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:9945:x1875232130378496:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788360924.012358:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360924.012376:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610892 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2f4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.012474:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.012488:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ed expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.012497:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.012818:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ed expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.012841:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ed expref: 23 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.012874:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89865b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144025600:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788360924.012998:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bada540 going to sleep for 11 seconds 00000100:00100000:3.0:1788360924.015263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.015354:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130378624 00000100:00100000:1.0:1788360924.015363:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130378624 00010000:00010000:1.0:1788360924.015399:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ed expref: 24 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360924.015442:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:1.0:1788360924.015451:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:2350:x1875232130378624:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360924.015466:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360924.015472:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ed expref: 24 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.015485:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ed expref: 24 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.015507:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788360924.015512:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.015522:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.015529:0:8303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.015547:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360924.015604:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:2350:x1875232130378624:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 153us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360924.015611:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00010000:00010000:0.0:1788360924.016037:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661087d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2ed expref: 23 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360924.016056:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89865b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144025600:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360924.016139:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.016316:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.016337:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360924.016356:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788360924.016504:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610892 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2f4 expref: 24 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.016519:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2f4 expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.016528:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788360924.016531:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788360924.016534:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e400, rc 0) 00000100:00100000:1.0:1788360924.016581:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:9945:x1875232130378496:12345-192.168.203.60@tcp:101:bash.0 Request processed in 4250us (4402us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788360924.016589:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:3.0:1788360924.018658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360924.018781:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130378880 00000100:00100000:0.0:1788360924.018792:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130378880 00000100:00100000:0.0:1788360924.018848:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:0.0:1788360924.018857:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:9945:x1875232130378880:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:0.0:1788360924.019261:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.019280:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.019294:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788360924.019383:0:6736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788360924.019411:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec62e4d3 reply state 000000005a8c9d06 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360924.019421:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788360924.019500:0:6736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788360924.020082:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:9945:x1875232130378880:12345-192.168.203.60@tcp:36:bash.0 Request processed in 1221us (1429us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788360924.020110:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000020:00080000:1.0:1788360924.020116:0:6736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788360924.022412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.022589:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130379008 00000100:00100000:1.0:1788360924.022599:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130379008 00000100:00100000:1.0:1788360924.022650:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788360924.022660:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:9945:x1875232130379008:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788360924.022685:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360924.022706:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d66108ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e2fb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.022776:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d66108ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2fb expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.022792:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d66108ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2fb expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.022811:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788360924.022814:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788360924.022818:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705ba00, rc 0) 00000100:00100000:1.0:1788360924.022877:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:9945:x1875232130379008:12345-192.168.203.60@tcp:101:bash.0 Request processed in 218us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360924.022895:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00010000:00010000:3.0:1788360924.023549:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.023560:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.023567:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.023573:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360924.023577:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.023586:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.023600:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:3.0:1788360924.023603:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360924.023607:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.023614:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66108a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.026271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.026410:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130379136 00000100:00100000:1.0:1788360924.026420:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130379136 00000100:00100000:1.0:1788360924.026490:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1788360924.026499:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:9945:x1875232130379136:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788360924.026514:0:6594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360924.026535:0:6594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c900d790/0xf6a94c97d66108b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e302 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788360924.026560:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9838d9, atime: 0x6a9838d8, ctime: 0x6a9838d9, blocks: 0xb 00010000:00010000:1.0:1788360924.026581:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:1.0:1788360924.026586:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788360924.026594:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c900d790/0xf6a94c97d66108b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e302 expref: 7 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.026624:0:6594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c900d790/0xf6a94c97d66108b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e302 expref: 7 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.026636:0:6594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a600, rc 0) 00000100:00100000:1.0:1788360924.026684:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:9945:x1875232130379136:12345-192.168.203.60@tcp:101:bash.0 Request processed in 187us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360924.026691:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00080000:3.0:1788360924.026737:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788360924.028801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.028909:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130379264 00000100:00100000:2.0:1788360924.028918:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130379264 00002000:00010000:2.0:1788360924.028957:0:6598:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788360924.028962:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f26a00 with x1875232130379264 ext(0->18446744073709551615) 00002000:00010000:2.0:1788360924.028973:0:6598:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89f26a00. 00000100:00100000:2.0:1788360924.029006:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:2.0:1788360924.029014:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130379264:12345-192.168.203.60@tcp:10:bash.0 00002000:00010000:2.0:1788360924.029305:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788360924.029309:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788360921 -> 1788360924 00002000:00010000:2.0:1788360924.029311:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788360920 -> 1788360920 00002000:00010000:2.0:1788360924.029314:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788360921 -> 1788360924 00002000:00010000:2.0:1788360924.029316:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788360924.029363:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2349:x1875232130379264:12345-192.168.203.60@tcp:10:bash.0 Request processed in 351us (570us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788360924.029369:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00002000:00010000:2.0:1788360924.029372:0:6598:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788360924.029373:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f26a00 with x1875232130379264 ext(0->18446744073709551615) 00002000:00010000:2.0:1788360924.029377:0:6598:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89f26a00. 00000100:00100000:0.0:1788360924.098960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.099045:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130379392 00000100:00100000:2.0:1788360924.099069:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130379392 00000100:00100000:2.0:1788360924.099287:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788360924.099306:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:10436:x1875232130379392:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788360924.099382:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66108bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099400:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66108bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099413:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66108bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099428:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66108c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099436:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66108c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099443:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66108c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099749:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099759:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099767:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360924.099817:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099847:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66108bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099854:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66108bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099861:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66108bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099867:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360924.099872:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66108bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099888:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66108bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099901:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:2.0:1788360924.099905:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360924.099909:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66108bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099915:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66108bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099927:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66108c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099933:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66108c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099939:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66108c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099949:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360924.099952:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66108c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099958:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66108c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099967:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8aa8ee1700) 00010000:00010000:2.0:1788360924.099969:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360924.099972:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66108c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099977:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66108c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099992:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.099997:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.100002:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.100007:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360924.100009:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.100015:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.100033:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788360924.100036:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360924.100039:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.100045:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66108ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.100189:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:10436:x1875232130379392:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 890us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360924.100198:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:3.0:1788360924.137251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.137399:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130379648 00000100:00100000:1.0:1788360924.137409:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130379648 00000100:00100000:1.0:1788360924.137476:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:1.0:1788360924.137487:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:10439:x1875232130379648:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360924.137509:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360924.137529:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d66108d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e309 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.137602:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66108d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.137618:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66108d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.137629:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66108d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.137645:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66108df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.137664:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66108df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.137672:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66108df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138457:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66108e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138471:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66108e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138480:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66108e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360924.138491:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788360924.138587:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66108d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138595:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66108d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138601:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66108d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138607:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360924.138612:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66108d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138620:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66108d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138644:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360924.138647:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360924.138652:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66108d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138658:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d66108d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138671:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66108df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138678:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66108df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138684:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66108df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138690:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360924.138692:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66108df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138698:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66108df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138704:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a99640200) 00010000:00010000:1.0:1788360924.138707:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360924.138709:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66108df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138714:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d66108df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138767:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d66108d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e309 expref: 30 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138781:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66108e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e309 expref: 29 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.138789:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788360924.138791:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788360924.138793:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705bc00, rc 0) 00000100:00100000:1.0:1788360924.138896:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:10439:x1875232130379648:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1410us (1654us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788360924.140806:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:0.0:1788360924.141691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.141731:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130379776 00000100:00100000:1.0:1788360924.141741:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130379776 00000100:00100000:1.0:1788360924.141802:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1788360924.141823:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:10439:x1875232130379776:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:1.0:1788360924.143082:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.143128:0:6736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2f4 expref: 29 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.143138:0:6736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.143181:0:6736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2f4 expref: 29 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.143226:0:6736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2f4 expref: 29 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360924.143241:0:6736:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6736:1875232144025728:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788360924.143350:0:6736:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788360924.146038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.146187:0:6736:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6736:1875232144025728:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360924.146211:0:6736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.146294:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130380032 00000100:00100000:2.0:1788360924.146302:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130380032 00000100:00100000:2.0:1788360924.146359:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:2.0:1788360924.146369:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+30:5560:x1875232130380032:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788360924.146691:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+31:5560:x1875232130380032:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 323us (660us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788360924.146699:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788360924.148335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.151990:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130380160 00000100:00100000:1.0:1788360924.152007:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130380160 00010000:00010000:1.0:1788360924.152058:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2f4 expref: 31 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360924.152150:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1788360924.152161:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+31:2350:x1875232130380160:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360924.152179:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360924.152199:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2f4 expref: 31 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.152215:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2f4 expref: 31 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.152238:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610899 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2f4 expref: 31 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.152260:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788360924.152266:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.152292:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.152299:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.152337:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360924.152401:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+30:2350:x1875232130380160:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 241us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360924.152409:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00010000:00010000:3.0:1788360924.152551:0:6736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.152559:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.152592:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.152599:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.152605:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.152612:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360924.152615:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.152623:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.152632:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:3.0:1788360924.152635:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788360924.152647:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.152654:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66108f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.152699:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:10439:x1875232130379776:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 10878us (11030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360924.152708:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:3.0:1788360924.159264:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.159829:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130380416 00000100:00100000:2.0:1788360924.159842:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130380416 00000100:00100000:2.0:1788360924.159956:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788360924.159967:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:10439:x1875232130380416:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788360924.160436:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+30:10439:x1875232130380416:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 470us (1355us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788360924.160445:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788360924.256826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.262049:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130380672 00000100:00100000:1.0:1788360924.262066:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130380672 00000100:00100000:1.0:1788360924.262186:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:1.0:1788360924.262198:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+30:10450:x1875232130380672:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:1.0:1788360924.262228:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360924.262252:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d66108fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e310 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262331:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610902 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262347:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610902 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262358:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610902 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262376:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d6610909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262402:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d6610909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262409:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d6610909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262743:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262753:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262761:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360924.262771:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788360924.262864:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610902 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262872:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610902 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262891:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610902 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262898:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360924.262902:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610902 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262909:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610902 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262932:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360924.262935:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360924.262940:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610902 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262946:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610902 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262958:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d6610909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262964:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d6610909 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262970:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d6610909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262976:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360924.262979:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d6610909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262985:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d6610909 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.262992:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a99640200) 00010000:00010000:1.0:1788360924.262995:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360924.262997:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d6610909 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.263002:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d6610909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.263059:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d66108fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e310 expref: 33 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.263073:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e310 expref: 32 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.263081:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788360924.263126:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360924.263130:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a800, rc 0) 00000100:00100000:1.0:1788360924.263205:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:10450:x1875232130380672:12345-192.168.203.60@tcp:101:cat.0 Request processed in 1009us (6405us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788360924.263214:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:3.0:1788360924.274174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360924.274639:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130380928 00000100:00100000:0.0:1788360924.274652:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130380928 00000100:00100000:0.0:1788360924.274718:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788360924.274728:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:10450:x1875232130380928:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:0.0:1788360924.274997:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+33:10450:x1875232130380928:12345-192.168.203.60@tcp:35:cat.0 Request processed in 269us (849us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788360924.275005:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788360924.302572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.302689:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130381184 00000100:00100000:3.0:1788360924.302699:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130381184 00000100:00100000:3.0:1788360924.302822:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:3.0:1788360924.302833:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+33:10451:x1875232130381184:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:3.0:1788360924.302902:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788360924.302928:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610910 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e310 expref: 33 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.302948:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66108e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e309 expref: 32 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.302959:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d66108ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2fb expref: 31 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.302969:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:3.0:1788360924.302979:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360924.302999:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661091e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.303028:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661091e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.303038:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661091e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.303052:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.303060:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.303067:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.303715:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d661092c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.303725:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d661092c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.303733:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d661092c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788360924.310707:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1788360924.310722:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314325635420ns, next at 315325631845ns, rc = 0 00010000:00010000:3.0:1788360924.310801:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310827:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310861:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310869:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310875:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310891:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310915:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788360924.310938:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d661092c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310944:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d661092c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310950:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d661092c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310955:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360924.310959:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d661092c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310968:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d661092c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310979:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:3.0:1788360924.310982:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788360924.310992:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d661092c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.310999:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d661092c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.311018:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661091e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.311025:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661091e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.311031:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661091e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.311036:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360924.311039:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661091e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.311045:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661091e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.311053:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:3.0:1788360924.311055:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360924.311058:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661091e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.311063:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661091e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788360924.311072:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008d9839a8 reply state 0000000027df1486 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.311122:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788360924.311207:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:10451:x1875232130381184:12345-192.168.203.60@tcp:36:rm.0 Request processed in 8372us (8641us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788360924.311216:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00010000:00010000:0.0:1788360924.311296:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788360924.311304:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.311310:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788360924.311313:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.311320:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.311340:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:0.0:1788360924.311342:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788360924.311346:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.311351:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610933 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.311365:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360924.311367:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360924.311368:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360924.318925:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.318945:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.318952:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.318958:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360924.318964:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.318972:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.318992:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a83c0b000) 00010000:00010000:0.0:1788360924.319006:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360924.319011:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.319036:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610925 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.380394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.380489:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130381440 00000100:00100000:1.0:1788360924.380498:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130381440 00000100:00100000:1.0:1788360924.380557:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:1.0:1788360924.380566:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+31:10457:x1875232130381440:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788360924.380591:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360924.380612:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d661093a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e317 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.380738:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610941 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.380753:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610941 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.380764:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610941 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.380795:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.380803:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.380810:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788360924.381418:0:5797:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788360924.381594:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381605:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381613:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381648:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610941 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381656:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610941 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381662:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610941 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381669:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360924.381673:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610941 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381691:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610941 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381703:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360924.381706:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360924.381710:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610941 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381715:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d6610941 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788360924.381727:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a6e57e9 reply state 0000000058fd3eac transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360924.381736:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788360924.381764:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a400/0xf6a94c97d661093a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e317 expref: 34 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381779:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e317 expref: 33 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.381786:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640b00) 00010000:00010000:1.0:1788360924.381789:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360924.381792:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705bc00, rc 0) 00000100:00100000:1.0:1788360924.381927:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:10457:x1875232130381440:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1361us (1543us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788360924.381936:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00010000:00010000:3.0:1788360924.386114:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.386135:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360924.386135:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1788360924.386147:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.386161:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ba00 already unused, calling callback (ffffffffc1fc84f0) 00000100:00100000:2.0:1788360924.386253:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130381568 00000100:00100000:2.0:1788360924.386263:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130381568 00000100:00100000:2.0:1788360924.386365:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1788360924.386376:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130381568:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788360924.386393:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360924.386412:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d661095d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e31e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788360924.386438:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788360924.386448:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.386458:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:3.0:1788360924.386459:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.386465:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360924.386478:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d661095d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e31e expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.386480:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a99640200) 00010000:00010000:3.0:1788360924.386487:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360924.386493:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.386501:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ba00/0xf6a94c97d6610948 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.386502:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d661095d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e31e expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.386522:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f000, rc 0) 00000100:00100000:2.0:1788360924.386593:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2349:x1875232130381568:12345-192.168.203.60@tcp:101:bash.0 Request processed in 208us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360924.386603:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00080000:0.0:1788360924.386656:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788360924.390005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.390128:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130381696 00000100:00100000:1.0:1788360924.390159:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130381696 00000100:00100000:0.0:1788360924.390532:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788360924.390542:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:10457:x1875232130381696:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788360924.390560:0:6594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360924.390578:0:6594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e325 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.390611:0:6594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d661095d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e31e expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.390621:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360924.390625:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360924.390631:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 9 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.390667:0:6594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d661095d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e31e expref: 9 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.390681:0:6594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d661095d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e31e expref: 9 pid: 6592 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360924.390695:0:6594:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6594:1875232144025856:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360924.390800:0:6594:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85014240 going to sleep for 11 seconds 00000100:00100000:0.0:1788360924.394908:0:6594:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6594:1875232144025856:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360924.394948:0:6594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 9 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.394973:0:6594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43a00, rc 0) 00000100:00100000:0.0:1788360924.395040:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:10457:x1875232130381696:12345-192.168.203.60@tcp:101:bash.0 Request processed in 4498us (5045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360924.395049:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:1.0:1788360924.397826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.398250:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130381824 00000100:00100000:2.0:1788360924.398261:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130381824 00010000:00010000:2.0:1788360924.398313:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d661095d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e31e expref: 9 pid: 6592 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.398422:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:2.0:1788360924.398435:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2350:x1875232130381824:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360924.398454:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360924.398482:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d661095d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e31e expref: 9 pid: 6592 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.398496:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d661095d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e31e expref: 9 pid: 6592 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.398518:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d661095d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e31e expref: 9 pid: 6592 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.398536:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360924.398540:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360924.398549:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 8 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.398559:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 8 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.398598:0:5784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 8 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.398615:0:5784:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a61c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5784:1875232144025984:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788360924.398770:0:5784:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788360924.403873:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.404003:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130382080 00000100:00100000:3.0:1788360924.404012:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130382080 00000100:00100000:3.0:1788360924.404082:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788360924.404123:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+33:10457:x1875232130382080:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:0.0:1788360924.404397:0:5784:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a61c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5784:1875232144025984:192.168.203.60@tcp:105: 00010000:00010000:0.0:1788360924.404419:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360924.404467:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130381824:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 6035us (6649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360924.404475:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788360924.404622:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:10457:x1875232130382080:12345-192.168.203.60@tcp:35:bash.0 Request processed in 502us (761us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788360924.404629:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:0.0:1788360924.535243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.535359:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130382208 00000100:00100000:1.0:1788360924.535370:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130382208 00000100:00100000:1.0:1788360924.535430:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:1.0:1788360924.535439:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:10473:x1875232130382208:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360924.535465:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360924.535487:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d661096b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e32c expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.535553:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d6610972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.535568:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d6610972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.535580:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d6610972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360924.535639:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1788360924.535643:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360924.535665:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d6610972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.535689:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d661096b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e32c expref: 36 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.535708:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d6610972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e32c expref: 35 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.535717:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360924.535733:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788360924.535737:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705be00, rc 0) 00000100:00100000:1.0:1788360924.535804:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:10473:x1875232130382208:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 366us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360924.535811:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:1.0:1788360924.547070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.547119:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130382464 00000100:00100000:3.0:1788360924.547130:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130382464 00000100:00100000:3.0:1788360924.547358:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:3.0:1788360924.547370:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:10473:x1875232130382464:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360924.547392:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360924.547422:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e333 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.547518:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.547532:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.547543:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360924.547554:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788360924.547692:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e333 expref: 38 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.547711:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e333 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.547737:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640b00) 00010000:00010000:3.0:1788360924.547740:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788360924.547744:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:3.0:1788360924.547809:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:10473:x1875232130382464:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 441us (745us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788360924.547816:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:2.0:1788360924.553676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.553774:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130382848 00000100:00100000:1.0:1788360924.553784:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130382848 00000100:00100000:1.0:1788360924.553850:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788360924.553861:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:2349:x1875232130382848:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360924.553875:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360924.553909:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e333 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.553927:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640b00) 00010000:00010000:1.0:1788360924.553931:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360924.554051:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:2349:x1875232130382848:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 191us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360924.554058:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788360924.554260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.554362:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130382720 00000100:00100000:1.0:1788360924.554367:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130382720 00000100:00100000:1.0:1788360924.554469:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:1.0:1788360924.554480:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:10473:x1875232130382720:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360924.554498:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360924.554512:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d661098e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e33a expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.554640:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610995 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.554655:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.554666:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360924.554678:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788360924.554796:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d661098e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e33a expref: 39 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.554811:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610995 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e33a expref: 38 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.554818:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640b00) 00010000:00010000:1.0:1788360924.554820:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788360924.554822:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705ac00, rc 0) 00000100:00100000:1.0:1788360924.554848:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+38:10473:x1875232130382720:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 371us (589us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788360924.554855:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:2.0:1788360924.563518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.563607:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130382976 00000100:00100000:1.0:1788360924.563618:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130382976 00000100:00100000:1.0:1788360924.563675:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788360924.563685:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130382976:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:1.0:1788360924.563729:0:9606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.563763:0:9606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 8 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.563771:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788360924.563775:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788360924.563779:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.563814:0:9606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 8 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.563828:0:9606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 8 pid: 6594 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360924.563842:0:9606:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9606:1875232144026112:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788360924.563937:0:9606:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788360924.566403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360924.566655:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130383104 00000100:00100000:0.0:1788360924.566666:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130383104 00002000:00100000:0.0:1788360924.566713:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a8abcbd3800 x1875232130383104/t0(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:740/0 lens 504/0 e 0 to 0 dl 1788360935 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788360924.566724:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abcbd3800 with x1875232130383104 ext(0->8) 00010000:00010000:0.0:1788360924.566759:0:6599:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 9 pid: 6594 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.566776:0:6599:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 9 pid: 6594 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788360924.566797:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8abcbd3800 00000100:00100000:0.0:1788360924.566829:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1788360924.566837:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2349:x1875232130383104:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:3.0:1788360924.567548:0:9606:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9606:1875232144026112:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360924.567582:0:9606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360924.567741:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:2349:x1875232130383104:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 902us (1344us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788360924.567751:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00002000:00100000:0.0:1788360924.567761:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a8abcbd3800 x1875232130383104/t4294967302(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:740/0 lens 504/448 e 0 to 0 dl 1788360935 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788360924.567770:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abcbd3800 with x1875232130383104 ext(0->8) 00010000:00010000:0.0:1788360924.567777:0:6599:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 11 pid: 6594 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.567789:0:6599:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 11 pid: 6594 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788360924.567796:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8abcbd3800 00000100:00100000:0.0:1788360924.571349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.571638:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130383232 00000100:00100000:3.0:1788360924.571649:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130383232 00010000:00010000:3.0:1788360924.571690:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 11 pid: 6594 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.571778:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:3.0:1788360924.571788:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:2350:x1875232130383232:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360924.571804:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788360924.571825:0:7487:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788360924.571829:0:7487:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788360925 00002000:00010000:3.0:1788360924.571831:0:7487:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788360925 00002000:00010000:3.0:1788360924.571833:0:7487:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788360925 00010000:00010000:3.0:1788360924.571839:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 11 pid: 6594 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.571872:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 11 pid: 6594 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.571905:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfb802ee/0xf6a94c97d6610964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e325 expref: 11 pid: 6594 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.571924:0:7487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788360924.571928:0:7487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788360924.571933:0:7487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.571943:0:7487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.571982:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360924.572038:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:2350:x1875232130383232:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 252us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360924.572047:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00010000:00010000:1.0:1788360924.572108:0:9606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.572117:0:9606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.572154:0:9606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.572175:0:9606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.572183:0:9606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.572190:0:9606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788360924.572194:0:9606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.572203:0:9606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.572215:0:9606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.572223:0:9606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66109a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360924.573006:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2350:x1875232130382976:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 9317us (9492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360924.573015:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:0.0:1788360924.575631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.576379:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130383488 00000100:00100000:2.0:1788360924.576390:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130383488 00000100:00100000:2.0:1788360924.576536:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1788360924.576546:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ea9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+38:10473:x1875232130383488:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:2.0:1788360924.576608:0:5800:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610995 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e33a expref: 38 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788360924.576944:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788360924.576990:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788360924.578543:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788360924.578603:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.578619:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e317 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.578624:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.578705:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e317 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.578717:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e317 expref: 42 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.578743:0:5800:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a62a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5800:1875232144026240:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360924.578826:0:5800:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788360924.581380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.581490:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130383616 00000100:00100000:3.0:1788360924.581502:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130383616 00010000:00010000:3.0:1788360924.581542:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e317 expref: 43 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.581585:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:3.0:1788360924.581596:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+43:2350:x1875232130383616:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360924.581633:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360924.581640:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e317 expref: 43 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.581652:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e317 expref: 43 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.581673:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640b00) 00010000:00010000:3.0:1788360924.581679:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.581688:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.581696:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.581714:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360924.581764:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+43:2350:x1875232130383616:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 170us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360924.581772:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00010000:00010000:2.0:1788360924.581983:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d661094f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e317 expref: 42 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.582000:0:5800:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a62a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5800:1875232144026240:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360924.582026:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.582035:0:5800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.582041:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788360924.582691:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788360924.582935:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788360924.583053:0:5800:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a62a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5800:1875232144026368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788360924.583122:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360924.583152:0:5800:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360924.583579:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144026368 00000100:00100000:3.0:1788360924.583587:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144026368 00000100:00080000:0.0:1788360924.583615:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788360924.583642:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788360924.583650:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5800:x1875232144026368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788360924.583760:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5800:x1875232144026368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 111us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360924.583768:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788360924.583890:0:5800:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a62a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5800:1875232144026368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788360924.584798:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788360924.584873:0:5800:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a62a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5800:1875232144026496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788360924.584928:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360924.584998:0:5800:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360924.585038:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144026496 00000100:00100000:3.0:1788360924.585044:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144026496 00000100:00100000:2.0:1788360924.585361:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788360924.585376:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5800:x1875232144026496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788360924.585560:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5800:x1875232144026496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 184us (630us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788360924.585567:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788360924.585674:0:5800:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a62a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5800:1875232144026496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788360924.585725:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788360924.585766:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.585777:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.585784:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.585791:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360924.585796:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.585804:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.585821:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640b00) 00010000:00010000:3.0:1788360924.585824:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788360924.585828:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.585835:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788360924.586018:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788360924.586281:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1788360924.586294:0:5800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 314601207042ns, next at 315601205176ns, rc = 0 00000001:00080000:3.0:1788360924.586302:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1788360924.586345:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640b00) 00010000:00010000:3.0:1788360924.586348:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788360924.586356:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610995 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e33a expref: 46 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.586671:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ea9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+45:10473:x1875232130383488:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 10126us (11049us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1788360924.586680:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000020:00080000:3.0:1788360924.586684:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788360924.589547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.589648:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130383744 00000100:00100000:1.0:1788360924.589659:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130383744 00000100:00100000:1.0:1788360924.589736:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:1.0:1788360924.589757:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+45:10473:x1875232130383744:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360924.589780:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360924.589800:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66109b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e341 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.589856:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66109b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e341 expref: 46 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.589870:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66109b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e341 expref: 46 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.589897:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360924.589900:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788360924.589904:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b200, rc 0) 00000100:00100000:1.0:1788360924.589990:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+46:10473:x1875232130383744:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 234us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360924.589997:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:0.0:1788360924.593064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.593304:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130384000 00000100:00100000:3.0:1788360924.593316:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130384000 00000100:00100000:3.0:1788360924.593374:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788360924.593383:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+46:10473:x1875232130384000:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788360924.593619:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+47:10473:x1875232130384000:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 237us (564us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788360924.593626:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:0.0:1788360924.650623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.650774:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130384128 00000100:00100000:3.0:1788360924.650784:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130384128 00000100:00100000:3.0:1788360924.650895:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:3.0:1788360924.650906:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+47:10483:x1875232130384128:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788360924.650982:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651000:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651012:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651044:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651053:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651060:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651223:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651233:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651240:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788360924.651314:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651328:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651334:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651341:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651347:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360924.651352:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651366:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651378:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:3.0:1788360924.651381:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360924.651385:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651391:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651403:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651410:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651416:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651421:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360924.651424:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651431:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651438:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a83c0bd00) 00010000:00010000:3.0:1788360924.651441:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360924.651443:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651459:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651473:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651479:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651486:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651491:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360924.651493:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651500:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651507:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:3.0:1788360924.651510:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360924.651512:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.651519:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.651582:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+47:10483:x1875232130384128:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 676us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360924.651590:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:0.0:1788360924.681675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.681778:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130384384 00000100:00100000:3.0:1788360924.681788:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130384384 00000100:00100000:3.0:1788360924.681852:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:3.0:1788360924.681862:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+47:10486:x1875232130384384:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360924.681892:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360924.681913:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e348 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.681992:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.682008:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.682020:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.682035:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.682041:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.682047:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.682774:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.682785:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.682794:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360924.682805:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788360924.682911:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.682919:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.682926:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.682932:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360924.682936:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.682943:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.682957:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:2.0:1788360924.682969:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360924.682974:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.682980:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66109d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.682995:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.683001:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.683007:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.683012:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360924.683014:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.683020:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.683027:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788360924.683030:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360924.683033:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.683039:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66109db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.683079:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66109cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e348 expref: 50 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.683257:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e348 expref: 49 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.683278:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360924.683281:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360924.683283:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:2.0:1788360924.683360:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+49:10486:x1875232130384384:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1499us (1695us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788360924.683369:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:1.0:1788360924.686734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.686863:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130384512 00000100:00100000:2.0:1788360924.686873:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130384512 00000100:00100000:2.0:1788360924.686969:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:2.0:1788360924.686979:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+49:10486:x1875232130384512:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:2.0:1788360924.687047:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66109f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.687063:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66109f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.687074:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66109f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.687122:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66109f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.687129:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66109f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.687224:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66109f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.687231:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360924.687236:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66109f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.687244:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66109f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.687256:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360924.687259:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788360924.687274:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66109f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.687281:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66109f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.687352:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+49:10486:x1875232130384512:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 374us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360924.687360:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:1.0:1788360924.689032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.689079:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130384768 00000100:00100000:3.0:1788360924.689110:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130384768 00000100:00100000:3.0:1788360924.689159:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:3.0:1788360924.689294:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+49:10486:x1875232130384768:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788360924.689545:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+50:10486:x1875232130384768:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 312us (521us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788360924.689565:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788360924.776020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360924.776361:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130385024 00000100:00100000:1.0:1788360924.776372:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130385024 00000100:00100000:1.0:1788360924.776430:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:1.0:1788360924.776440:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+50:10496:x1875232130385024:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788360924.776466:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360924.776469:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788360924.776494:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d6610972 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e32c expref: 50 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.776531:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360924.776536:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788360924.776549:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d66109f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e34f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.776643:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.776670:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e348 expref: 50 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.776679:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.776712:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e348 expref: 50 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.776724:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e348 expref: 50 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360924.776737:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144026624:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788360924.776829:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1788360924.781122:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144026624:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360924.781159:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360924.784949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.785043:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130385152 00000100:00100000:2.0:1788360924.785054:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130385152 00010000:00010000:2.0:1788360924.785122:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e348 expref: 51 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.785277:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:2.0:1788360924.785287:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+51:2350:x1875232130385152:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360924.785304:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360924.785311:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e348 expref: 51 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.785323:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e348 expref: 51 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.785346:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66109e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e348 expref: 51 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.785362:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360924.785368:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.785377:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.785385:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.785478:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360924.785527:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+50:2350:x1875232130385152:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 242us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360924.785535:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00010000:00010000:1.0:1788360924.786015:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.786024:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360924.786056:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788360924.786591:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d66109f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e34f expref: 51 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.786611:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e34f expref: 50 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.786619:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360924.786622:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788360924.786625:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705aa00, rc 0) 00000100:00100000:1.0:1788360924.786674:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+50:10496:x1875232130385024:12345-192.168.203.60@tcp:101:bash.0 Request processed in 10235us (10666us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788360924.786682:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:0.0:1788360924.791727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.791840:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130385408 00000100:00100000:3.0:1788360924.791850:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130385408 00000100:00100000:2.0:1788360924.792359:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:2.0:1788360924.792389:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+50:10496:x1875232130385408:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:2.0:1788360924.794223:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.794243:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.794257:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788360924.794350:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788360924.794383:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075b304de reply state 00000000e48274d5 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.794402:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788360924.794506:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+53:10496:x1875232130385408:12345-192.168.203.60@tcp:36:bash.0 Request processed in 2117us (2784us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788360924.794514:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00000020:00080000:2.0:1788360924.794520:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788360924.797048:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.797064:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.797072:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.797078:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360924.797083:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.797117:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.797478:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360924.797482:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360924.797488:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360924.797494:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610a0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360924.797624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.798017:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130385536 00000100:00100000:2.0:1788360924.798026:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130385536 00000100:00100000:2.0:1788360924.798124:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:2.0:1788360924.798135:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:10496:x1875232130385536:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788360924.798173:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360924.798190:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610a13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e356 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.798269:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.798312:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e34f expref: 53 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.798320:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.798355:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e34f expref: 53 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.798367:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e34f expref: 53 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.798381:0:5798:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1875232144026752:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360924.798459:0:5798:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788360924.800677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.800752:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130385664 00000100:00100000:3.0:1788360924.800762:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130385664 00010000:00010000:3.0:1788360924.800799:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e34f expref: 54 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.800842:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:3.0:1788360924.800852:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:2350:x1875232130385664:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360924.800897:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360924.800906:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e34f expref: 54 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.800919:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e34f expref: 54 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.800940:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:3.0:1788360924.800945:0:7487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.800955:0:7487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.800962:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.800982:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360924.801044:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:2350:x1875232130385664:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 193us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360924.801052:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00010000:00010000:2.0:1788360924.802686:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d66109fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e34f expref: 53 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.802710:0:5798:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1875232144026752:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360924.802733:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.802743:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.802749:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360924.802792:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788360924.802810:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360924.802830:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.802862:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610a13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e356 expref: 53 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.802886:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e356 expref: 52 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.802895:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360924.802898:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360924.802901:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f000, rc 0) 00000100:00100000:2.0:1788360924.802956:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:10496:x1875232130385536:12345-192.168.203.60@tcp:101:bash.0 Request processed in 4822us (5334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360924.802964:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:0.0:1788360924.809078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.809432:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130385920 00000100:00100000:2.0:1788360924.809442:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130385920 00000100:00100000:2.0:1788360924.809500:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:2.0:1788360924.809510:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:10496:x1875232130385920:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1788360924.809791:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+53:10496:x1875232130385920:12345-192.168.203.60@tcp:35:bash.0 Request processed in 281us (721us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788360924.809799:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:0.0:1788360924.865278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.865593:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130386048 00000100:00100000:2.0:1788360924.865604:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130386048 00000100:00100000:2.0:1788360924.865661:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:2.0:1788360924.865670:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+53:10503:x1875232130386048:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360924.865692:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360924.865723:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610a21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e35d expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.865783:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.865797:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.865807:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360924.865849:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788360924.865852:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360924.865873:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.865910:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610a21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e35d expref: 55 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.867074:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e35d expref: 54 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.867167:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:2.0:1788360924.867172:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788360924.867176:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fc00, rc 0) 00000100:00100000:2.0:1788360924.867240:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:10503:x1875232130386048:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1569us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360924.867248:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:1.0:1788360924.871628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360924.872047:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130386176 00000100:00100000:0.0:1788360924.872059:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130386176 00000100:00100000:0.0:1788360924.872475:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:0.0:1788360924.872487:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:10503:x1875232130386176:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360924.872511:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360924.872531:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e364 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872612:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872627:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872638:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872660:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872667:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872675:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872784:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872794:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872801:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360924.872836:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788360924.872840:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788360924.872857:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872867:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872886:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872893:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872899:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.872904:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360924.872908:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873512:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873533:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:0.0:1788360924.873536:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360924.873542:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873547:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873560:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873566:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873572:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873576:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360924.873579:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873635:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873644:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8a983bff00) 00010000:00010000:0.0:1788360924.873647:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360924.873650:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873655:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873707:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e364 expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873722:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e364 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.873906:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:0.0:1788360924.873909:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788360924.873911:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43c00, rc 0) 00000100:00100000:0.0:1788360924.874627:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:10503:x1875232130386176:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 2139us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360924.874635:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:2.0:1788360924.878467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360924.878533:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.878592:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130386560 00000100:00100000:3.0:1788360924.878601:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130386560 00000100:00100000:3.0:1788360924.878651:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:3.0:1788360924.878660:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:10503:x1875232130386560:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360924.878680:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360924.878699:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610a4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e36b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.878791:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.878804:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e356 expref: 56 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.878812:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e364 expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.878818:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.878852:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e364 expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.878864:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e364 expref: 56 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.878901:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0c56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144026880:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360924.878941:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130386304 00000100:00100000:0.0:1788360924.878946:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130386304 00010000:00010000:0.0:1788360924.878966:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e364 expref: 57 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360924.878985:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00010000:00010000:3.0:1788360924.878992:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e356 expref: 57 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360924.878992:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:2350:x1875232130386304:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360924.879000:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e356 expref: 57 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.879001:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360924.879006:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e364 expref: 57 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.879009:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0c54700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144027008:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360924.879017:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e364 expref: 57 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.879031:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a829d0540 going to sleep for 11 seconds 00010000:00010000:0.0:1788360924.879044:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:0.0:1788360924.879048:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.879055:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.879061:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360924.879099:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:2350:x1875232130386304:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 94us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360924.879107:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00010000:00010000:0.0:1788360924.882681:0:5799:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.60@tcp) returned -22 from blocking AST (req@0000000059ec0077 x1875232144026880) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e364 expref: 56 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.882703:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e364 expref: 56 pid: 5797 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360924.882719:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0c56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144026880:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360924.882733:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0c54700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144027008:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360924.882755:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:0.0:1788360924.882760:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.882768:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.882791:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360924.883240:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360924.883288:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130386688 00000100:00100000:3.0:1788360924.883296:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130386688 00010000:00010000:3.0:1788360924.883329:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e356 expref: 56 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360924.883373:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:3.0:1788360924.883382:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:2349:x1875232130386688:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360924.883395:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360924.883410:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e356 expref: 56 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.883420:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e356 expref: 56 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.883440:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610a1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e356 expref: 56 pid: 5798 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.883464:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:3.0:1788360924.883468:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.883475:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.883482:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360924.883552:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788360924.883576:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.883583:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360924.883601:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788360924.883740:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610a4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e36b expref: 57 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.883757:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e36b expref: 56 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360924.883765:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360924.883768:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788360924.883770:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fa00, rc 0) 00000100:00100000:2.0:1788360924.883817:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:10503:x1875232130386560:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 5157us (5282us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788360924.883824:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:0.0:1788360924.885000:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:2349:x1875232130386688:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1613us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360924.885013:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:3.0:1788360924.888250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360924.888316:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130386944 00000100:00100000:0.0:1788360924.888326:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130386944 00000100:00100000:0.0:1788360924.888389:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788360924.888408:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:10503:x1875232130386944:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:0.0:1788360924.888424:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360924.888449:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d66109b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e341 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.888466:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:0.0:1788360924.888471:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360924.888520:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:10503:x1875232130386944:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 123us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360924.888528:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788360924.889918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360924.890073:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130387072 00000100:00100000:0.0:1788360924.890082:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130387072 00000100:00100000:0.0:1788360924.890154:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:0.0:1788360924.890231:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:10503:x1875232130387072:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:0.0:1788360924.890352:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.890378:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.890390:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788360924.890556:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788360924.890636:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:10503:x1875232130387072:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 473us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360924.890644:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:3.0:1788360924.892010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360924.892065:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130387200 00000100:00100000:0.0:1788360924.892073:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130387200 00000100:00100000:0.0:1788360924.892376:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:0.0:1788360924.892385:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:10503:x1875232130387200:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360924.892403:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360924.892423:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610a67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e372 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.892469:0:6736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.892479:0:6736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610a67 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e372 expref: 55 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.892496:0:6736:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.892510:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610a67 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e372 expref: 55 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.892532:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:0.0:1788360924.892535:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788360924.892539:0:6736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610a67 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e372 expref: 55 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360924.892547:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43200, rc 0) 00000100:00100000:0.0:1788360924.892634:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:10503:x1875232130387200:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 249us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360924.892642:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000001:00080000:1.0:1788360924.895619:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788360924.895646:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1788360924.895654:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:0.0:1788360924.897410:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788360925.219192:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788360925.219202:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788360925.219249:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788360925.219256:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788360925.219369:0:11534:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144027136:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788360925.219468:0:11534:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788360925.222605:0:11534:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144027136:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788360925.223173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.223251:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130387328 00000100:00100000:0.0:1788360925.223258:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130387328 00000100:00100000:0.0:1788360925.223334:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:0.0:1788360925.223343:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:10504:x1875232130387328:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788360925.223374:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788360925.223469:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:10504:x1875232130387328:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 126us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.223476:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00080000:3.0:1788360925.223581:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360925.229516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.229779:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130387456 00000100:00100000:0.0:1788360925.229790:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130387456 00000100:00100000:0.0:1788360925.229914:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:0.0:1788360925.229926:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:10504:x1875232130387456:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788360925.230004:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a6e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230038:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230053:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230165:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230174:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230181:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230205:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230213:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230220:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360925.230260:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788360925.230275:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788360925.230289:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230299:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230319:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a6e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230326:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230332:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360925.230336:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230343:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a6e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230357:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:0.0:1788360925.230360:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360925.230365:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230370:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610a6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230383:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230398:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a75 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230405:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230410:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360925.230420:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230427:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a75 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230435:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9a8a983bff00) 00010000:00010000:0.0:1788360925.230437:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360925.230439:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a75 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230444:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610a75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230460:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230466:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230471:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230476:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360925.230478:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230483:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230489:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:0.0:1788360925.230492:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360925.230500:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.230506:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.230586:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:10504:x1875232130387456:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 663us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.230594:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:3.0:1788360925.233082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360925.233734:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130387712 00000100:00100000:2.0:1788360925.233745:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130387712 00000100:00100000:2.0:1788360925.233815:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:2.0:1788360925.233825:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:10504:x1875232130387712:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788360925.233846:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360925.233866:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610a83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e379 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.233981:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610a8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.233997:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.234009:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360925.234020:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788360925.234347:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.234356:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610a8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.234364:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.234370:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360925.234375:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.234466:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610a8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.234479:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360925.234482:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788360925.234486:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610a8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.234493:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610a8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.234539:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610a83 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e379 expref: 57 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.234549:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:2.0:1788360925.234551:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788360925.234556:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610a83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e379 expref: 57 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.234567:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:2.0:1788360925.234674:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:10504:x1875232130387712:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 849us (1602us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788360925.234681:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:3.0:1788360925.237393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360925.237476:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130387840 00000100:00100000:1.0:1788360925.237487:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130387840 00000100:00100000:1.0:1788360925.237582:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:1.0:1788360925.237592:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:10504:x1875232130387840:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788360925.237629:0:5798:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788360925.237741:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:10504:x1875232130387840:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 150us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360925.237748:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:2.0:1788360925.240215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.240557:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130388096 00000100:00100000:0.0:1788360925.240566:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130388096 00000100:00100000:0.0:1788360925.240677:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:0.0:1788360925.240687:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:10504:x1875232130388096:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788360925.240712:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360925.240716:0:6736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788360925.240744:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610a28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e35d expref: 56 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.240762:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:0.0:1788360925.240768:0:6736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788360925.240780:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e380 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788360925.241661:0:6736:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788360925.241928:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610a9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.241946:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.241972:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.242053:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610a98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e380 expref: 58 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.242072:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e380 expref: 57 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.242080:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a983bf600) 00010000:00010000:0.0:1788360925.242083:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788360925.242110:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43400, rc 0) 00000100:00100000:0.0:1788360925.242168:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:10504:x1875232130388096:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1483us (1962us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788360925.242177:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:0.0:1788360925.249739:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360925.249961:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130388352 00000100:00100000:2.0:1788360925.249971:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130388352 00000100:00100000:2.0:1788360925.250080:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:2.0:1788360925.250130:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:10504:x1875232130388352:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788360925.250213:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360925.250253:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610a9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e380 expref: 57 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250404:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a983bf600) 00010000:00010000:2.0:1788360925.250418:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788360925.250442:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610aad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250522:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610aad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250534:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610aad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250623:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610ab4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x97d1d31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250630:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x97d1d31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250635:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x97d1d31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250700:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610aad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250705:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610aad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250710:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610aad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250719:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360925.250722:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610aad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250727:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610aad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250733:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:2.0:1788360925.250735:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360925.250738:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610aad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250742:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610aad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250748:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x97d1d31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250751:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610ab4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x97d1d31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250754:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610ab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x97d1d31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250757:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360925.250759:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610ab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x97d1d31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250762:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610ab4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x97d1d31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250772:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x97d1d31f (ffff9a8aa8ee1700) 00010000:00010000:2.0:1788360925.250774:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360925.250775:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610ab4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x97d1d31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.250778:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6610ab4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x97d1d31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360925.250863:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:10504:x1875232130388352:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 743us (1136us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788360925.250869:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:3.0:1788360925.252740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360925.252828:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130388480 00000100:00100000:1.0:1788360925.252837:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130388480 00000100:00100000:1.0:1788360925.252901:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:1.0:1788360925.252910:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:10504:x1875232130388480:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788360925.252930:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360925.252951:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610abb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e387 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.253011:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.253023:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.253032:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.253167:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610abb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e387 expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.253187:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e387 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.253195:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a99640500) 00010000:00010000:1.0:1788360925.253197:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788360925.253200:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a200, rc 0) 00000100:00100000:1.0:1788360925.253250:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:10504:x1875232130388480:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 341us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360925.253256:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:3.0:1788360925.256790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360925.256890:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130388736 00000100:00100000:1.0:1788360925.256901:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130388736 00000100:00100000:1.0:1788360925.256961:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:1.0:1788360925.256971:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:10504:x1875232130388736:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788360925.257061:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.257129:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.257142:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788360925.257424:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:1.0:1788360925.257549:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5cc4fac reply state 000000006c5bee77 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360925.257558:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788360925.257644:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:10504:x1875232130388736:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 674us (859us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788360925.257652:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00010000:00010000:0.0:1788360925.259606:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.259621:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.259628:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.259633:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360925.259637:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.259660:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.259676:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a99640500) 00010000:00010000:0.0:1788360925.259679:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788360925.259683:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.259689:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6610ac9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360925.260160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.260594:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130388864 00000100:00100000:0.0:1788360925.260606:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130388864 00000100:00100000:0.0:1788360925.260658:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:0.0:1788360925.260666:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+58:10504:x1875232130388864:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788360925.260690:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360925.260708:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610ad0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e38e expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.260761:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e38e expref: 59 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.260774:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e38e expref: 59 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.260791:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a99640500) 00010000:00010000:0.0:1788360925.260794:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788360925.261195:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42200, rc 0) 00000100:00100000:0.0:1788360925.261366:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:10504:x1875232130388864:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 699us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.261373:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:3.0:1788360925.264046:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360925.264334:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130388992 00000100:00100000:2.0:1788360925.264345:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130388992 00000100:00100000:2.0:1788360925.264477:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:2.0:1788360925.264488:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130388992:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788360925.264967:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2350:x1875232130388992:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 478us (927us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788360925.264974:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:2.0:1788360925.267284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360925.267369:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130389248 00000100:00100000:3.0:1788360925.267384:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130389248 00000100:00100000:3.0:1788360925.267495:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:3.0:1788360925.267504:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:10504:x1875232130389248:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788360925.267828:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:10504:x1875232130389248:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 324us (551us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788360925.267835:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:2.0:1788360925.269186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.269382:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130389504 00000100:00100000:0.0:1788360925.269388:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130389504 00000100:00100000:0.0:1788360925.269482:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:0.0:1788360925.269492:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:10504:x1875232130389504:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788360925.269592:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:10504:x1875232130389504:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 102us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.269600:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:3.0:1788360925.271532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360925.271829:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130389632 00000100:00100000:2.0:1788360925.271839:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130389632 00000100:00100000:2.0:1788360925.271909:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:2.0:1788360925.271932:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:10504:x1875232130389632:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788360925.271951:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360925.271970:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610ad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e395 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.272042:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.272057:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.272068:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360925.272131:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360925.272160:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.272774:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610ad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e395 expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.272851:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e395 expref: 61 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.272862:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a99640500) 00010000:00010000:2.0:1788360925.272864:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788360925.272868:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:2.0:1788360925.272948:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:10504:x1875232130389632:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1017us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360925.272967:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:2.0:1788360925.278768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360925.278823:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130389760 00000100:00100000:1.0:1788360925.278834:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130389760 00000100:00100000:1.0:1788360925.278938:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:1.0:1788360925.278949:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2351:x1875232130389760:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788360925.278970:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360925.278990:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f27f334/0xf6a94c97d6610ae5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e39c expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788360925.279017:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9838dd, blocks: 0x1 00010000:00010000:1.0:1788360925.279037:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1788360925.279042:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788360925.279051:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f27f334/0xf6a94c97d6610ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e39c expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.279131:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f27f334/0xf6a94c97d6610ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e39c expref: 10 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.279147:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b000, rc 0) 00000100:00100000:1.0:1788360925.279211:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:2351:x1875232130389760:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 264us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360925.279219:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788360925.282305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360925.282372:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130390016 00000100:00100000:2.0:1788360925.282382:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130390016 00000100:00100000:2.0:1788360925.282441:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:2.0:1788360925.282451:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:10504:x1875232130390016:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788360925.282564:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:10504:x1875232130390016:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 115us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360925.282572:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:3.0:1788360925.286961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.287059:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130390144 00000100:00100000:0.0:1788360925.287069:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130390144 00000100:00100000:0.0:1788360925.287279:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:0.0:1788360925.287290:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:10504:x1875232130390144:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788360925.287310:0:6594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360925.287330:0:6594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3a3 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.287366:0:6594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f27f334/0xf6a94c97d6610ae5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e39c expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.287375:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360925.287379:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360925.287662:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 11 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.287718:0:6594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f27f334/0xf6a94c97d6610ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e39c expref: 11 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.287732:0:6594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f27f334/0xf6a94c97d6610ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e39c expref: 11 pid: 6592 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.287745:0:6594:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f27800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6594:1875232144027264:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360925.287885:0:6594:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788360925.292340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360925.293337:0:6594:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f27800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6594:1875232144027264:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360925.293371:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130390272 00010000:00010000:3.0:1788360925.293378:0:6594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 11 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360925.293381:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130390272 00010000:00010000:2.0:1788360925.293423:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f27f334/0xf6a94c97d6610ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e39c expref: 12 pid: 6592 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360925.293469:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:2.0:1788360925.293478:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:2350:x1875232130390272:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360925.293494:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360925.293520:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f27f334/0xf6a94c97d6610ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e39c expref: 12 pid: 6592 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.293534:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f27f334/0xf6a94c97d6610ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e39c expref: 12 pid: 6592 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.293560:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f27f334/0xf6a94c97d6610ae5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e39c expref: 12 pid: 6592 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.293594:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360925.293599:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360925.293606:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 11 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.293616:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 11 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.293650:0:6594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43c00, rc 0) 00010000:00010000:2.0:1788360925.293653:0:8303:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 11 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360925.293670:0:8303:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8303:1875232144027392:192.168.203.60@tcp:105: 00000100:00100000:3.0:1788360925.293765:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:10504:x1875232130390144:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 6476us (6812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360925.293774:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1788360925.296043:0:8303:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788360925.302203:0:8303:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8303:1875232144027392:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788360925.302252:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360925.302358:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:2350:x1875232130390272:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 8881us (10026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360925.302369:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:0.0:1788360925.303624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360925.303716:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130390400 00000100:00100000:3.0:1788360925.303725:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130390400 00002000:00100000:3.0:1788360925.303768:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a8a89f24a80 x1875232130390400/t0(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:741/0 lens 504/0 e 0 to 0 dl 1788360936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788360925.303780:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24a80 with x1875232130390400 ext(0->12) 00002000:00010000:3.0:1788360925.303784:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89f24a80 00000100:00100000:3.0:1788360925.303813:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788360925.303821:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:2350:x1875232130390400:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788360925.304370:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:2350:x1875232130390400:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 546us (748us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788360925.304378:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00002000:00100000:3.0:1788360925.305320:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a8a89f24a80 x1875232130390400/t4294967308(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:741/0 lens 504/448 e 0 to 0 dl 1788360936 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788360925.305335:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24a80 with x1875232130390400 ext(0->12) 00002000:00010000:3.0:1788360925.305351:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89f24a80 00000100:00100000:2.0:1788360925.307108:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360925.307179:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130390528 00000100:00100000:1.0:1788360925.307189:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130390528 00000100:00100000:1.0:1788360925.307235:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:1.0:1788360925.307244:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:10504:x1875232130390528:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788360925.343938:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:0.0:1788360925.343970:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a85f49b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788360925.343976:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a8a6b6e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a85f49e40 00000020:00080000:0.0:1788360925.343979:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a8a6b6400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a90b09800 00000001:00080000:0.0:1788360925.343995:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000020:00080000:0.0:1788360925.344029:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a8a5cfcc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788360925.344032:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8abce2ed00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a8a5cfc00 00000020:00080000:0.0:1788360925.344035:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8abce2ea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ac0d07000 00000001:00080000:0.0:1788360925.344057:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788360925.344068:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:0.0:1788360925.344121:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788360925.344156:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788360925.344353:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788360925.344540:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144027520:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788360925.344619:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360925.344691:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144027648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360925.344717:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360925.344737:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360925.344742:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144027776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788360925.344761:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360925.344794:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144027520 00000100:00100000:0.0:1788360925.344800:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144027520 00000100:00100000:0.0:1788360925.344837:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144027776 00000100:00100000:0.0:1788360925.344841:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144027776 00000100:00100000:0.0:1788360925.344869:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788360925.344889:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144027520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788360925.344912:0:9606:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1788360925.344940:0:9606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9838dd, atime: 0x6a9838dd, ctime: 0x6a9838dd, blocks: 0xb 00010000:00010000:0.0:1788360925.344947:0:9606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c58ccb1/0xf6a94c97d6610af3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.344963:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1788360925.344968:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360925.344974:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c58ccb1/0xf6a94c97d6610af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.344989:0:9606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c58ccb1/0xf6a94c97d6610af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.344999:0:9606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c58ccb1/0xf6a94c97d6610af3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345013:0:9606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c58ccb1/0xf6a94c97d6610af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345030:0:9606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788360925.345514:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144027520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 624us (892us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788360925.345521:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788360925.345540:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788360925.345548:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144027776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788360925.345563:0:9606:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788360925.345577:0:9606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345591:0:9606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c900d790/0xf6a94c97d66108b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e302 expref: 11 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345599:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788360925.345602:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788360925.345606:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345632:0:9606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c900d790/0xf6a94c97d66108b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e302 expref: 11 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345645:0:9606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c900d790/0xf6a94c97d66108b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e302 expref: 11 pid: 6594 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.345665:0:9606:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144027904:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360925.345723:0:9606:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788360925.345740:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144027648 00000100:00100000:0.0:1788360925.345745:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144027648 00000100:00100000:0.0:1788360925.345772:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788360925.345778:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144027648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788360925.345790:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3855613952 00000100:00100000:0.0:1788360925.345823:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144027648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.345830:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788360925.345850:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788360925.345862:0:11019:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788360925.345868:0:11019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c58ccb1/0xf6a94c97d6610af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345888:0:11019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788360925.345892:0:11019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c58ccb1/0xf6a94c97d6610af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345902:0:11019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c58ccb1/0xf6a94c97d6610af3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345918:0:11019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c58ccb1/0xf6a94c97d6610af3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345935:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c58ccb1/0xf6a94c97d6610af3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.345954:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360925.345956:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360925.345958:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360925.346078:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788360925.346128:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1788360925.346152:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a83f99500, transno 4294967301 00000004:00080000:0.0:1788360925.346160:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1788360925.346179:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144027648:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788360925.346421:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a89f27800/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788360925.346428:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144027520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788360925.346730:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:10504:x1875232130390528:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 39485us (39628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360925.346739:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:1.0:1788360925.347406:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144028032:0@lo:400:kworker.0 00000100:00100000:1.0:1788360925.347454:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360925.347548:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144028032 00000100:00100000:3.0:1788360925.347554:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144028032 00000100:00100000:3.0:1788360925.347593:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788360925.347599:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144028032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360925.347940:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144028416:0@lo:400:kworker.0 00000100:00100000:0.0:1788360925.347969:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360925.347990:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788360925.347995:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144028288:0@lo:400:kworker.0 00000100:00100000:0.0:1788360925.348015:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360925.348039:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144028160:0@lo:400:kworker.0 00000100:00100000:0.0:1788360925.348061:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360925.348102:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144028416 00000100:00100000:0.0:1788360925.348106:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144028416 00000100:00100000:0.0:1788360925.348145:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144028288 00000100:00100000:0.0:1788360925.348149:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144028288 00000100:00100000:0.0:1788360925.348162:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144028160 00000100:00100000:0.0:1788360925.348175:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144028160 00000100:00100000:0.0:1788360925.348192:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788360925.348198:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144028416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360925.348236:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144028416:12345-0@lo:400:kworker.0 Request processed in 39us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.348242:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788360925.348257:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788360925.348263:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144028288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360925.348287:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144028288:12345-0@lo:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.348293:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788360925.348303:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788360925.348309:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144028160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360925.348336:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144028160:12345-0@lo:400:kworker.0 Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.348342:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1788360925.348360:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360925.348384:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144028288:0@lo:400:kworker.0 00000100:00100000:0.0:1788360925.348393:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144028416:0@lo:400:kworker.0 00000100:00100000:0.0:1788360925.348416:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144028160:0@lo:400:kworker.0 00000100:00100000:3.0:1788360925.348888:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144028032:12345-0@lo:400:kworker.0 Request processed in 1287us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360925.348896:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788360925.348967:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144028032:0@lo:400:kworker.0 00000100:00100000:2.0:1788360925.351456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.351630:0:9606:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144027904:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360925.351660:0:9606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360925.351788:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130390656 00000100:00100000:1.0:1788360925.351794:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130390656 00010000:00010000:1.0:1788360925.351828:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c900d790/0xf6a94c97d66108b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e302 expref: 12 pid: 6594 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360925.351865:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:1.0:1788360925.351886:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:2350:x1875232130390656:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360925.351902:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360925.351908:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c900d790/0xf6a94c97d66108b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e302 expref: 12 pid: 6594 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.351929:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c900d790/0xf6a94c97d66108b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e302 expref: 12 pid: 6594 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.351952:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c900d790/0xf6a94c97d66108b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e302 expref: 12 pid: 6594 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.351967:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788360925.351972:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788360925.351977:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.351987:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.352236:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360925.352296:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:2350:x1875232130390656:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 422us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360925.352303:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00010000:00010000:2.0:1788360925.353002:0:9606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.353016:0:9606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.353036:0:9606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.353044:0:9606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.353128:0:9606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788360925.353935:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144027776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8385us (9168us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788360925.353944:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1788360925.354070:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788360925.354078:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.354507:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788360925.354512:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.354523:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.354542:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.354549:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049978e15/0xf6a94c97d6610afa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.354570:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360925.354571:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360925.354573:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788360925.354798:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8985a61f80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788360925.354819:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144027776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788360925.354936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360925.355007:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130390784 00000100:00100000:1.0:1788360925.355013:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130390784 00000100:00100000:1.0:1788360925.355074:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788360925.355082:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:2350:x1875232130390784:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788360925.383998:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1788360925.384020:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788360925.384026:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788360925.384031:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1788360925.384039:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788360925.384351:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130390784:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 29263us (29411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360925.384363:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1788360925.386734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360925.386831:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130391040 00000100:00100000:1.0:1788360925.386841:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130391040 00000100:00100000:1.0:1788360925.386908:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:1.0:1788360925.386932:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:10504:x1875232130391040:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788360925.386987:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360925.387016:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e395 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.387035:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a99640500) 00010000:00010000:1.0:1788360925.387039:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788360925.387069:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.387126:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.387149:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788360925.387397:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000701e317c reply state 00000000c54f19ed transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360925.387407:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788360925.387758:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:10504:x1875232130391040:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 827us (1031us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788360925.387766:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00010000:00010000:0.0:1788360925.390773:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.390790:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.390817:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.390823:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360925.390828:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.390836:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.390851:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a99640500) 00010000:00010000:0.0:1788360925.390854:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360925.390858:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.390865:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360925.390959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.391025:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130391168 00000100:00100000:0.0:1788360925.391034:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130391168 00000100:00100000:0.0:1788360925.391112:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:0.0:1788360925.391122:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130391168:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788360925.391400:0:6594:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788360925.391404:0:6594:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788360925 00002000:00010000:0.0:1788360925.391406:0:6594:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788360925 00002000:00010000:0.0:1788360925.391408:0:6594:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788360925 -> 1788360925 00002000:00010000:0.0:1788360925.391411:0:6594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788360925.391621:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130391168:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 499us (666us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788360925.391640:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:1.0:1788360925.396029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.396127:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130391424 00000100:00100000:0.0:1788360925.396284:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130391424 00000100:00100000:0.0:1788360925.396345:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:0.0:1788360925.396355:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:10504:x1875232130391424:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788360925.396578:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.396595:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e387 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.396604:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.396637:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e387 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.396650:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e387 expref: 15 pid: 5797 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.396663:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a45880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144028544:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360925.396772:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788360925.399719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360925.399791:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130391552 00000100:00100000:3.0:1788360925.399800:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130391552 00010000:00010000:3.0:1788360925.399835:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e387 expref: 16 pid: 5797 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360925.399888:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:3.0:1788360925.399897:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:2349:x1875232130391552:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360925.399914:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360925.399946:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e387 expref: 16 pid: 5797 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.399959:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e387 expref: 16 pid: 5797 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.399983:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a99640500) 00010000:00010000:3.0:1788360925.399989:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.399998:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.400005:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.400022:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360925.400077:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:2349:x1875232130391552:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 181us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360925.400111:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00010000:00010000:0.0:1788360925.402630:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e387 expref: 15 pid: 5797 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.402653:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a45880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144028544:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360925.402693:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.402992:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.402999:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.403031:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.403038:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.403045:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.403051:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360925.403054:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.403062:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.403078:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a99640500) 00010000:00010000:0.0:1788360925.403081:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788360925.403402:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.403410:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610b08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.403515:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:10504:x1875232130391424:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 7160us (7492us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788360925.403526:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:1.0:1788360925.405982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.406055:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130391680 00000100:00100000:0.0:1788360925.406066:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130391680 00000100:00100000:0.0:1788360925.406156:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1788360925.406315:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130391680:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788360925.406356:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.406377:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 7 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.406385:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360925.406399:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788360925.406404:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.406438:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 7 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.406451:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 7 pid: 6594 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.406474:0:6593:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6593:1875232144028672:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360925.406563:0:6593:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788360925.410103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360925.410576:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130391808 00000100:00100000:2.0:1788360925.410585:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130391808 00010000:00010000:2.0:1788360925.410623:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 8 pid: 6594 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360925.410669:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:2.0:1788360925.410678:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130391808:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360925.410693:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360925.410715:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 8 pid: 6594 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.410729:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 8 pid: 6594 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.410769:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788360925.410774:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788360925.410780:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.410792:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.410816:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360925.410869:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130391808:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 191us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360925.410887:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00010000:00010000:0.0:1788360925.411502:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024b0f7fe/0xf6a94c97d6610aec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3a3 expref: 7 pid: 6594 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.411532:0:6593:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6593:1875232144028672:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360925.411552:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.411563:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.411570:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.411598:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.411605:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.411611:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.411618:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788360925.411622:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.411644:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.411659:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.411668:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6610b0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.411916:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130391680:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 5605us (5941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.411926:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:1.0:1788360925.413830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.414244:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130392064 00000100:00100000:0.0:1788360925.414254:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130392064 00000100:00100000:0.0:1788360925.414317:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:0.0:1788360925.414326:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:10504:x1875232130392064:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788360925.414402:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610b16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.414419:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.414430:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.414632:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.414652:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610ad0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e38e expref: 15 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.414661:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.414704:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e38e expref: 15 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.414718:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e38e expref: 15 pid: 6736 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.414733:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a45880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144028800:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360925.414803:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788360925.418411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360925.418572:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130392192 00000100:00100000:2.0:1788360925.418581:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130392192 00010000:00010000:2.0:1788360925.418617:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610ad0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e38e expref: 16 pid: 6736 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360925.418708:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:0.0:1788360925.418747:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a45880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144028800:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360925.418769:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:2350:x1875232130392192:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360925.418773:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.418786:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360925.418795:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e38e expref: 16 pid: 6736 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.418806:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e38e expref: 16 pid: 6736 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.418864:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610ad0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e38e expref: 16 pid: 6736 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.418889:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a99640500) 00010000:00010000:2.0:1788360925.418895:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.418903:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.418911:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.418936:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360925.418989:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:2350:x1875232130392192:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 224us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360925.418997:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00010000:00010000:0.0:1788360925.419049:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.419058:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788360925.420454:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788360925.421729:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788360925.421777:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788360925.421865:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1875232144028928:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788360925.421941:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360925.421975:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a829d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788360925.422623:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144028928 00000100:00100000:0.0:1788360925.422631:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144028928 00000100:00100000:0.0:1788360925.422730:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788360925.422753:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1875232144028928:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788360925.422843:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1875232144028928:12345-0@lo:1000:mdt00_000.0 Request processed in 93us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.422851:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788360925.422949:0:5797:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788360925.422954:0:5797:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1788360925.422972:0:5797:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8985a61f80, transno 4294967309 00000100:00100000:1.0:1788360925.422987:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1875232144028928:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788360925.423566:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788360925.423624:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f90700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1875232144029056:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788360925.423659:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360925.424083:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788360925.424283:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144029056 00000100:00100000:2.0:1788360925.424289:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144029056 00000100:00100000:2.0:1788360925.424321:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788360925.424329:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1875232144029056:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788360925.424625:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1875232144029056:12345-0@lo:1000:mdt00_000.0 Request processed in 296us (965us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788360925.424633:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788360925.424712:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f90700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1875232144029056:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788360925.424745:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424755:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424762:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424768:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360925.424772:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424781:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424804:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a99640500) 00010000:00010000:1.0:1788360925.424807:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788360925.424811:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424818:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b1d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424850:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424857:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424862:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424867:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360925.424870:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424888:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424895:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360925.424897:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788360925.424904:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610a67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e372 expref: 18 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424915:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610a67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e372 expref: 18 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424933:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610a67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e372 expref: 18 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.424962:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610a67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e372 expref: 18 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360925.424975:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144029184:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788360925.425033:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1788360925.427505:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144029184:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788360925.427534:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427561:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610a60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427594:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427607:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427619:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427627:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427633:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b24 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427639:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427644:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360925.427648:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427655:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b24 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427664:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360925.427667:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360925.427670:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b24 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427701:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b24 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427712:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427718:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610b16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427724:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610b16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427729:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360925.427732:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610b16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427737:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610b16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427744:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360925.427747:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788360925.427749:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610b16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.427755:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610b16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360925.427989:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:10504:x1875232130392064:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 13660us (14161us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788360925.428000:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00000020:00080000:2.0:1788360925.428012:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788360925.428273:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788360925.428278:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788360925.428860:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788360925.428869:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788360925.430117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.430222:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130392320 00000100:00100000:0.0:1788360925.430231:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130392320 00000100:00100000:0.0:1788360925.430285:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788360925.430295:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:10503:x1875232130392320:12345-192.168.203.60@tcp:49:lfs.0 00000100:00100000:0.0:1788360925.430411:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:10503:x1875232130392320:12345-192.168.203.60@tcp:49:lfs.0 Request processed in 117us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.430418:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:3.0:1788360925.433191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.433317:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130392576 00000100:00100000:0.0:1788360925.433327:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130392576 00000100:00100000:0.0:1788360925.433378:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788360925.433387:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84eab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:10504:x1875232130392576:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788360925.434026:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788360925.434190:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788360925.434236:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.434251:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.434262:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.434271:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.434290:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.434297:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.434320:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788360925.434404:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84eab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:10504:x1875232130392576:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1016us (1220us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788360925.434412:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000020:00080000:0.0:1788360925.434418:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788360925.434672:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788360925.434680:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.434686:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788360925.434690:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.434698:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.434717:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:3.0:1788360925.434720:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788360925.434724:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.434730:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610b2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360925.434747:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360925.434749:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360925.434751:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360925.437195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360925.437366:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130392832 00000100:00100000:2.0:1788360925.437376:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130392832 00000100:00100000:2.0:1788360925.437445:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:2.0:1788360925.437455:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:10503:x1875232130392832:12345-192.168.203.60@tcp:58:lfs.0 00000040:00080000:2.0:1788360925.437753:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788360925.437841:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:10503:x1875232130392832:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 387us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360925.437850:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:1.0:1788360925.469011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360925.470081:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130392960 00000100:00100000:3.0:1788360925.470107:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130392960 00000100:00100000:2.0:1788360925.470593:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:2.0:1788360925.470605:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:10506:x1875232130392960:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360925.470632:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360925.470653:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3aa expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.470729:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610b39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.470742:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610b39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.470754:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610b39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.470767:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610b40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.470773:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.470799:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.471124:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.471135:0:6736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e36b expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.471143:0:6736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.471175:0:6736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e36b expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360925.471188:0:6736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e36b expref: 21 pid: 5799 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360925.471201:0:6736:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6736:1875232144029312:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360925.471296:0:6736:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788360925.475843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.476006:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130393216 00000100:00100000:0.0:1788360925.476015:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130393216 00000100:00100000:0.0:1788360925.476074:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1788360925.476111:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:5559:x1875232130393216:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788360925.476367:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:5559:x1875232130393216:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 284us (533us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788360925.476375:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1788360925.476812:0:6736:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6736:1875232144029312:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360925.476837:0:6736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360925.478529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360925.478604:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130393344 00000100:00100000:0.0:1788360925.478611:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130393344 00010000:00010000:0.0:1788360925.478641:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e36b expref: 23 pid: 5799 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360925.478675:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:0.0:1788360925.478684:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:2350:x1875232130393344:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360925.478697:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360925.478717:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e36b expref: 23 pid: 5799 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.478729:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e36b expref: 23 pid: 5799 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.478750:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610a52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e36b expref: 23 pid: 5799 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.478765:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:0.0:1788360925.478770:0:7487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.478779:0:7487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.478785:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360925.478896:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360925.478948:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:2350:x1875232130393344:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 264us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360925.478955:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00010000:00010000:1.0:1788360925.479488:0:6736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479497:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360925.479543:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788360925.479547:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360925.479567:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479579:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479604:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610b39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479611:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610b39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479618:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610b39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479624:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360925.479627:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610b39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479635:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610b39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479646:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360925.479649:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360925.479660:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610b39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479666:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610b39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479680:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479686:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610b40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479692:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479703:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360925.479706:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479712:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610b40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479720:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a8aa8ee1c00) 00010000:00010000:1.0:1788360925.479722:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360925.479725:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610b40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479731:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610b40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479920:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3aa expref: 22 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479934:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3aa expref: 21 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360925.479941:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360925.479943:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360925.479946:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:1.0:1788360925.479994:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:10506:x1875232130392960:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 9391us (10991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360925.480002:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00000004:00080000:1.0:1788360925.856472:0:8051:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315871383141ns, next at 316871381060ns, rc = 0 00000100:00100000:1.0:1788360925.856517:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788360925.856537:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144029440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788360925.856609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360925.856675:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144029440 00000100:00100000:1.0:1788360925.856684:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144029440 00000100:00100000:1.0:1788360925.856726:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788360925.856734:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144029440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788360925.856756:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788360925.856798:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144029440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360925.856805:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788360925.856852:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144029440:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788360925.922196:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788360926.196795:0:11958:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788360926.196804:0:11958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788360926.196853:0:11958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788360926.196860:0:11958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788360926.432655:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788360926.432665:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788360926.432729:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788360926.432736:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788360926.432997:0:11534:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f99500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144029568:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788360926.433179:0:11534:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360926.438410:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360926.438511:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130393472 00000100:00100000:2.0:1788360926.438530:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130393472 00000100:00100000:2.0:1788360926.438589:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:2.0:1788360926.438599:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:10518:x1875232130393472:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788360926.438649:0:5798:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788360926.438762:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:10518:x1875232130393472:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 163us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360926.438769:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:1.0:1788360926.439928:0:11534:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f99500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144029568:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788360926.447560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360926.447723:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130393728 00000100:00100000:1.0:1788360926.447739:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130393728 00000100:00100000:1.0:1788360926.447823:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:1.0:1788360926.447847:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:10518:x1875232130393728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788360926.447885:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360926.447913:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610b4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3b1 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360926.448071:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610b55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360926.448112:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360926.448132:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360926.448157:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788360926.448329:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610b4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3b1 expref: 24 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360926.448354:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3b1 expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360926.448364:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360926.448368:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360926.448388:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705ac00, rc 0) 00000100:00100000:1.0:1788360926.448481:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:10518:x1875232130393728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 637us (928us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788360926.448490:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:3.0:1788360926.453589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360926.453631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360926.453698:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130394112 00000100:00100000:0.0:1788360926.453715:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130394112 00000100:00100000:0.0:1788360926.453815:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1788360926.454111:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130393984 00000100:00100000:2.0:1788360926.454122:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130393984 00000100:00100000:0.0:1788360926.454144:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:2350:x1875232130394112:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360926.454170:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788360926.454190:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:2.0:1788360926.454203:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:10518:x1875232130393984:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788360926.454211:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610b55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3b1 expref: 24 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360926.454241:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:0.0:1788360926.454249:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788360926.454304:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360926.454325:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360926.454338:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:2350:x1875232130394112:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 199us (703us total) trans 0 rc 0/0 00010000:00010000:2.0:1788360926.454340:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360926.454359:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:2.0:1788360926.454529:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360926.454536:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360926.454541:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360926.454544:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360926.454547:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360926.454565:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360926.454574:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:2.0:1788360926.454576:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788360926.454579:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360926.454583:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610b63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788360926.458033:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788360926.458048:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788360926.458069:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:10518:x1875232130393984:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 3858us (4477us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788360926.458083:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 132 00000040:00080000:1.0:1788360926.459309:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788360926.459329:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788360926.460677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360926.460758:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130394368 00000100:00100000:0.0:1788360926.460784:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130394368 00000100:00100000:0.0:1788360926.460886:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:0.0:1788360926.460902:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:10518:x1875232130394368:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788360926.461263:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:10518:x1875232130394368:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 366us (592us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788360926.461273:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1788360926.863820:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360926.863878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360926.863977:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130394624 00000100:00100000:2.0:1788360926.863987:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130394624 00000100:00100000:2.0:1788360926.864044:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:2.0:1788360926.864053:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:2349:x1875232130394624:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360926.864168:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:2349:x1875232130394624:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 116us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360926.864175:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:3.0:1788360926.866042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360926.866080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360926.866270:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130394496 00000100:00100000:2.0:1788360926.866279:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130394496 00000100:00100000:2.0:1788360926.866327:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 276 00000100:00100000:2.0:1788360926.866335:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130394496:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360926.866401:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130394496:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360926.866426:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 276 00000100:00100000:3.0:1788360926.870962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360926.871054:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130395008 00000100:00100000:1.0:1788360926.871064:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130395008 00000100:00100000:1.0:1788360926.871170:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788360926.871181:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130395008:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360926.871256:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130395008:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 77us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360926.871264:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00080000:3.0:1788360926.872635:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360926.872823:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130394880 00000100:00100000:0.0:1788360926.872832:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130394880 00000100:00080000:3.0:1788360926.872916:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788360926.873358:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130394752 00000100:00100000:2.0:1788360926.873364:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130394752 00000100:00100000:2.0:1788360926.873405:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:2.0:1788360926.873414:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130394880:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360926.873474:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130394880:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 62us (9595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360926.873480:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1788360926.873624:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:1.0:1788360926.873667:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130394752:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360926.873711:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130394752:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 50us (7629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360926.873718:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00080000:3.0:1788360926.873911:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788360926.944815:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788360927.928391:0:12009:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788360927.928401:0:12009:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788360927.928445:0:12009:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788360927.928450:0:12009:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788360927.969961:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360928.125181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360928.125286:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130395264 00000100:00100000:1.0:1788360928.125297:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130395264 00000100:00080000:3.0:1788360928.125360:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788360928.125363:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:1.0:1788360928.125373:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:10538:x1875232130395264:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360928.125396:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360928.125417:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3b8 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.125513:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d6610b71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.125527:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d6610b71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.125539:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d6610b71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360928.125550:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788360928.125673:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610b6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3b8 expref: 27 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.125691:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d6610b71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3b8 expref: 26 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.125699:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360928.125702:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788360928.125706:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b800, rc 0) 00000100:00100000:1.0:1788360928.125776:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:10538:x1875232130395264:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 405us (604us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788360928.125784:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:3.0:1788360928.128213:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360928.128347:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130395392 00000100:00100000:1.0:1788360928.128359:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130395392 00000100:00100000:1.0:1788360928.128412:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:1.0:1788360928.128423:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:10538:x1875232130395392:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:1.0:1788360928.128515:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610b7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.128532:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.128547:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.128572:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.128580:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610b7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.128602:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.128609:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360928.128613:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.128622:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610b7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.128636:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360928.128639:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788360928.128643:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610b7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360928.128650:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610b7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360928.129018:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:10538:x1875232130395392:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 594us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360928.129027:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:3.0:1788360928.220943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360928.221313:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130395520 00000100:00100000:2.0:1788360928.221324:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130395520 00000100:00080000:3.0:1788360928.221436:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788360928.221499:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:2.0:1788360928.221510:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130395520:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:2.0:1788360928.221529:0:9606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360928.221550:0:9606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610b86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3bf expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788360928.221863:0:9606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9838dd, atime: 0x6a9838dd, ctime: 0x6a9838dd, blocks: 0xb 00010000:00010000:2.0:1788360928.221889:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:2.0:1788360928.221894:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360928.221905:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610b86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3bf expref: 7 pid: 9606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360928.221925:0:9606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610b86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3bf expref: 7 pid: 9606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360928.222025:0:9606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f000, rc 0) 00000100:00100000:2.0:1788360928.222271:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130395520:12345-192.168.203.60@tcp:101:cat.0 Request processed in 762us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360928.222278:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:3.0:1788360928.228670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360928.228776:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130395648 00000100:00100000:0.0:1788360928.228795:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130395648 00002000:00100000:0.0:1788360928.228847:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9a8a8926c700 x1875232130395648/t0(0) o3->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:744/0 lens 488/0 e 0 to 0 dl 1788360939 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788360928.228879:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926c700 with x1875232130395648 ext(0->4095) 00002000:00010000:0.0:1788360928.228895:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926c700 00000100:00100000:0.0:1788360928.228930:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788360928.228940:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130395648:12345-192.168.203.60@tcp:3:cat.0 00000100:00100000:0.0:1788360928.229428:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130395648:12345-192.168.203.60@tcp:3:cat.0 Request processed in 489us (776us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788360928.229435:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00002000:00100000:0.0:1788360928.229442:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9a8a8926c700 x1875232130395648/t0(0) o3->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:744/0 lens 488/4536 e 0 to 0 dl 1788360939 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788360928.229451:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926c700 with x1875232130395648 ext(0->4095) 00002000:00010000:0.0:1788360928.229455:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926c700 00010000:00010000:1.0:1788360928.992209:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360930.018621:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788360930.026642:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:3.0:1788360930.468270:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144030080:0@lo:400:kworker.0 00000100:00100000:3.0:1788360930.468343:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360930.468901:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144029696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360930.468938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360930.469245:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144030208:0@lo:400:kworker.0 00000100:00100000:0.0:1788360930.469278:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360930.469285:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144029824:0@lo:400:kworker.0 00000100:00100000:3.0:1788360930.469329:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360930.469383:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144029696 00000100:00100000:0.0:1788360930.469390:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144029696 00000100:00100000:0.0:1788360930.469442:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788360930.469453:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144029696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788360930.469557:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360930.469607:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144029696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360930.469625:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788360930.469662:0:3312:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788360930.469668:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a89f27800, transno 4294967304 00000100:00100000:0.0:1788360930.469683:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144029696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360930.470320:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144030208 00000100:00100000:2.0:1788360930.470327:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144030208 00000100:00100000:2.0:1788360930.471053:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788360930.471169:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144030080 00000100:00100000:0.0:1788360930.471175:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144030080 00000100:00100000:0.0:1788360930.471212:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788360930.471223:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144030080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360930.471298:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144030080:12345-0@lo:400:kworker.0 Request processed in 77us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360930.471305:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788360930.471353:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144029952:0@lo:400:kworker.0 00000100:00100000:0.0:1788360930.471388:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360930.471411:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144030464:0@lo:400:kworker.0 00000100:00100000:0.0:1788360930.471436:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360930.471505:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144029824 00000100:00100000:3.0:1788360930.471511:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144029824 00000100:00100000:2.0:1788360930.471592:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144030464 00000100:00100000:2.0:1788360930.471597:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144030464 00000100:00100000:3.0:1788360930.471636:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788360930.471646:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144029824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360930.471690:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144029824:12345-0@lo:400:kworker.0 Request processed in 46us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360930.471697:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788360930.471701:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788360930.471712:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144030464:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788360930.471730:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788360930.471737:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788360930.471740:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788360930.471776:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144030080:0@lo:400:kworker.0 00000100:00100000:3.0:1788360930.471804:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144029824:0@lo:400:kworker.0 00000100:00100000:3.0:1788360930.471812:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144030336:0@lo:400:kworker.0 00000100:00100000:0.0:1788360930.474674:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144029952 00000100:00100000:0.0:1788360930.474690:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144029952 00000100:00100000:0.0:1788360930.474747:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788360930.474757:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144029952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360930.475382:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144030464:12345-0@lo:400:kworker.0 Request processed in 3669us (3941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360930.475394:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788360930.475538:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360930.475576:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144030464:0@lo:400:kworker.0 00000100:00100000:2.0:1788360930.475619:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144030336 00000100:00100000:2.0:1788360930.475623:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144030336 00000100:00100000:2.0:1788360930.475657:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788360930.475663:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144030336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360930.475745:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144030336:0@lo:400:kworker.0 00000100:00080000:3.0:1788360930.475776:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360930.476156:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144029952:12345-0@lo:400:kworker.0 Request processed in 1399us (4765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360930.476164:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788360930.476269:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144030208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360930.476313:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144030208:12345-0@lo:400:kworker.0 Request processed in 5252us (7035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360930.476331:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788360930.476367:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144030208:0@lo:400:kworker.0 00000100:00100000:3.0:1788360930.476684:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144029952:0@lo:400:kworker.0 00000100:00100000:2.0:1788360930.477235:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144030336:12345-0@lo:400:kworker.0 Request processed in 1569us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360930.477244:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000001:00080000:0.0:1788360930.529478:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1788360930.529505:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1788360930.529530:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000004:00080000:0.0:1788360930.529540:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788360930.529542:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1788360930.529561:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a883c7900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788360930.529562:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1788360930.529569:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ab7666a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a883c70c0 00000020:00080000:0.0:1788360930.529573:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ab7666700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ab7063000 00000020:00080000:2.0:1788360930.529606:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:0.0:1788360930.529678:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144030592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788360930.529769:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788360930.529819:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1788360930.530676:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144030592 00000100:00100000:0.0:1788360930.530685:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144030592 00000100:00100000:0.0:1788360930.532618:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788360930.532638:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144030592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788360930.532990:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788360930.532993:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788360925 -> 1788360925 00002000:00010000:0.0:1788360930.532995:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1788360925 -> 1788360925 00002000:00010000:0.0:1788360930.532997:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788360925 -> 1788360925 00002000:00010000:0.0:1788360930.532999:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788360930.533214:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144030592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 582us (3444us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788360930.533222:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1788360930.533277:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ac0a47b80/2, rc 0, transno 4294967312 00000100:00100000:1.0:1788360930.533287:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144030592:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1788360930.533766:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788360930.533779:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:2.0:1788360930.976942:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788360930.976967:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144030720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788360930.977044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360930.977612:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144030720 00000100:00100000:1.0:1788360930.977622:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144030720 00000100:00100000:1.0:1788360930.977684:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788360930.977695:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144030720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788360930.977747:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360930.977810:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144030720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360930.977818:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788360930.978193:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788360930.978199:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1788360930.978222:0:3311:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8ac0a47b80 x1875232144030592/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788360946 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360930.978241:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144030720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788360931.041109:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360931.997474:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360931.997546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360931.997581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360931.997601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360931.997622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360931.997695:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130396032 00000100:00100000:0.0:1788360931.997706:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130396032 00000100:00100000:0.0:1788360931.997768:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130396160 00000100:00100000:0.0:1788360931.997771:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130396160 00000100:00100000:0.0:1788360931.997794:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:0.0:1788360931.997805:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130396032:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360931.997900:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130396032:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 97us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360931.997907:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:0.0:1788360931.997925:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:0.0:1788360931.997931:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130396160:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360931.997956:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130396160:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360931.997962:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:0.0:1788360931.997981:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130396288 00000100:00100000:0.0:1788360931.997984:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130396288 00000100:00100000:0.0:1788360931.998007:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130395904 00000100:00100000:0.0:1788360931.998010:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130395904 00000100:00100000:0.0:1788360931.998031:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:0.0:1788360931.998037:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130396288:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360931.998065:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2349:x1875232130396288:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360931.998071:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:0.0:1788360931.998083:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:0.0:1788360931.998127:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:2349:x1875232130395904:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360931.998154:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:2349:x1875232130395904:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360931.998175:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00080000:2.0:1788360931.999121:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788360931.999128:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788360931.999131:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788360932.002329:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130395776 00000100:00100000:1.0:1788360932.002357:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130395776 00000100:00100000:1.0:1788360932.002453:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 278 00000100:00100000:1.0:1788360932.002463:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130395776:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360932.002546:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2349:x1875232130395776:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 84us (5082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360932.002555:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 278 00010000:00010000:1.0:1788360932.064257:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360932.219646:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360932.219745:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130396416 00000100:00100000:0.0:1788360932.219755:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130396416 00000100:00100000:0.0:1788360932.219817:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:0.0:1788360932.219834:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:10183:x1875232130396416:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788360932.219941:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:10183:x1875232130396416:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360932.219948:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:3.0:1788360932.226331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360932.226412:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130396672 00000100:00100000:0.0:1788360932.226423:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130396672 00000100:00100000:0.0:1788360932.226480:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788360932.226489:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:10183:x1875232130396672:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788360932.227008:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:10183:x1875232130396672:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 517us (682us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788360932.227016:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:3.0:1788360932.541547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360932.544134:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130396800 00000100:00100000:0.0:1788360932.544150:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130396800 00000100:00100000:0.0:1788360932.544225:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 136 00000100:00100000:0.0:1788360932.544236:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:10990:x1875232130396800:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:0.0:1788360932.544256:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360932.544277:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610b8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3c6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360932.544339:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360932.544374:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360932.544397:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360932.544592:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788360932.544596:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788360932.544691:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360932.544719:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610b8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3c6 expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360932.545214:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3c6 expref: 6 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360932.545223:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:0.0:1788360932.545226:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788360932.545230:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43e00, rc 0) 00000100:00100000:0.0:1788360932.545304:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:10990:x1875232130396800:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 1069us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360932.545311:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 136 00010000:00010000:0.0:1788360933.090620:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360934.114828:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360935.136246:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360935.585176:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144030976:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.585246:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360935.585295:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144031488:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.585327:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360935.585392:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788360935.585401:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144030848:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.585439:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360935.585483:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144031360:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.585525:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360935.585594:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144031104:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.585626:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360935.585654:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788360935.585662:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144031232:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.585701:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360935.585747:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144030976 00000100:00100000:2.0:1788360935.585755:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144030976 00000100:00100000:2.0:1788360935.585814:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144031360 00000100:00100000:2.0:1788360935.585818:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144031360 00000100:00100000:2.0:1788360935.585842:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144031104 00000100:00100000:2.0:1788360935.585845:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144031104 00000100:00100000:2.0:1788360935.585862:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788360935.585870:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144030976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.585921:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144030976:12345-0@lo:400:kworker.0 Request processed in 51us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360935.585928:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788360935.585946:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788360935.585951:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144031360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.585978:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144031360:12345-0@lo:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360935.585984:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788360935.585998:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788360935.586006:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144031104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.586042:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144031104:12345-0@lo:400:kworker.0 Request processed in 37us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360935.586058:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788360935.586081:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144031488 00000100:00100000:2.0:1788360935.586103:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144031488 00000100:00100000:2.0:1788360935.586130:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144031232 00000100:00100000:2.0:1788360935.586133:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144031232 00000100:00100000:2.0:1788360935.586158:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788360935.586165:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144031488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.586205:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144031488:12345-0@lo:400:kworker.0 Request processed in 40us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360935.586212:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788360935.586213:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788360935.586229:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788360935.586235:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144031232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.586260:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144031232:12345-0@lo:400:kworker.0 Request processed in 26us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360935.586266:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788360935.586283:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144030848 00000100:00100000:2.0:1788360935.586287:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144030848 00000100:00100000:2.0:1788360935.586316:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788360935.586324:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144030848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.586355:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144030848:12345-0@lo:400:kworker.0 Request processed in 33us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360935.586363:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1788360935.586406:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788360935.586410:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788360935.586413:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360935.586469:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144031232:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.586494:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144031104:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.586533:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144030848:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.586544:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144031360:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.586553:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144030976:0@lo:400:kworker.0 00000100:00100000:2.0:1788360935.586563:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144031488:0@lo:400:kworker.0 00000100:00100000:0.0:1788360935.587066:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144031616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360935.587469:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360935.587968:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144031616 00000100:00100000:2.0:1788360935.587975:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144031616 00000100:00100000:2.0:1788360935.588013:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788360935.588021:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144031616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788360935.588052:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788360935.588120:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144031616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360935.588129:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788360935.588212:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144031616:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788360935.626248:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788360935.627200:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788360935.627328:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788360935.627341:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1788360935.630167:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:02000400:3.0:1788360935.689406:0:12209:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:55:35 (1788360935) 00000100:00100000:0.0:1788360936.096429:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144031744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788360936.096519:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360936.102719:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144031744 00000100:00100000:1.0:1788360936.102737:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144031744 00000100:00100000:1.0:1788360936.102824:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788360936.102835:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144031744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788360936.102890:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360936.102984:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144031744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (6464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360936.102992:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788360936.103253:0:3312:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788360936.103260:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ac0a47b80, transno 4294967312 00000100:00100000:0.0:1788360936.103285:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144031744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788360936.160309:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788360936.738270:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788360936.738283:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788360936.738673:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:0.0:1788360936.738682:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788360937.011596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360937.012619:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130397056 00000100:00100000:0.0:1788360937.012631:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130397056 00000100:00100000:0.0:1788360937.012935:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:0.0:1788360937.012950:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:11255:x1875232130397056:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788360937.012976:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360937.012996:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610b9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013079:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ba2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013119:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013132:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013165:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610ba9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013172:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013179:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788360937.013519:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788360937.013707:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610bb0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013717:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013724:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360937.013735:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788360937.013926:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013933:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013940:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013945:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360937.013949:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013966:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ba2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013978:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a983bf900) 00010000:00010000:0.0:1788360937.013981:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360937.013985:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ba2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.013990:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ba2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.014002:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.014007:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.014012:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.014017:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360937.014019:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.014025:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.014031:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a983bfd00) 00010000:00010000:0.0:1788360937.014033:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360937.014035:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610ba9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.014051:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610ba9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.014455:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d6610b9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3cd expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.014472:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3cd expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360937.014479:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:0.0:1788360937.014481:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360937.014484:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43c00, rc 0) 00000100:00100000:0.0:1788360937.014554:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:11255:x1875232130397056:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1609us (2966us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788360937.015170:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:3.0:1788360937.023216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360937.023393:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130397184 00000100:00100000:2.0:1788360937.023403:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130397184 00000100:00100000:2.0:1788360937.023458:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:2.0:1788360937.023467:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:11255:x1875232130397184:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788360937.023559:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:11255:x1875232130397184:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360937.023564:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:3.0:1788360937.032392:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360937.032462:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130397312 00000100:00100000:2.0:1788360937.032485:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130397312 00000100:00100000:2.0:1788360937.032598:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788360937.032608:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:2350:x1875232130397312:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360937.032623:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360937.032647:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610bb0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3cd expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360937.032676:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:2.0:1788360937.032680:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360937.032741:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:2350:x1875232130397312:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 134us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360937.032749:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1788360937.095529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360937.095576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360937.095618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360937.095656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360937.095688:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130397568 00000100:00100000:1.0:1788360937.095712:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130397568 00000100:00100000:1.0:1788360937.095767:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130397696 00000100:00100000:1.0:1788360937.095770:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130397696 00000100:00100000:1.0:1788360937.095805:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:1.0:1788360937.095815:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130397568:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360937.095891:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2350:x1875232130397568:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 78us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360937.095899:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:1.0:1788360937.095914:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1788360937.095921:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130397696:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360937.095945:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130397696:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360937.095951:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00080000:1.0:1788360937.095973:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788360937.095977:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788360937.096162:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130397824 00000100:00100000:3.0:1788360937.096167:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130397824 00000100:00100000:3.0:1788360937.096211:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:3.0:1788360937.096219:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2350:x1875232130397824:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360937.096258:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2350:x1875232130397824:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 40us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360937.096271:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00080000:1.0:1788360937.096410:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360937.097111:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130397440 00000100:00100000:0.0:1788360937.097117:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130397440 00000100:00100000:0.0:1788360937.097162:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 280 00000100:00100000:0.0:1788360937.097172:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2350:x1875232130397440:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360937.097237:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2350:x1875232130397440:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 68us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360937.097245:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 280 00010000:00010000:0.0:1788360937.185217:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788360937.762134:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788360937.762145:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788360937.762498:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:1.0:1788360937.762507:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788360938.208207:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360938.559255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360938.566182:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130397952 00000100:00100000:0.0:1788360938.566198:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130397952 00000100:00100000:0.0:1788360938.566257:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:0.0:1788360938.566275:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:11297:x1875232130397952:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360938.566298:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360938.566318:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3d4 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566378:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610bc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566392:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566403:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566416:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610bcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566422:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566428:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566773:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566793:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566800:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566816:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360938.566821:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566828:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566842:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:0.0:1788360938.566845:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360938.566850:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610bc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566856:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610bc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566868:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566874:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610bcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566880:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610bcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566885:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360938.566888:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610bcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566894:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610bcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566914:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a8a983bf000) 00010000:00010000:0.0:1788360938.566916:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360938.566920:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610bcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566927:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610bcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566961:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610bbe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3d4 expref: 15 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566972:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:0.0:1788360938.566974:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360938.566978:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3d4 expref: 15 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.566987:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42a00, rc 0) 00000100:00100000:0.0:1788360938.567178:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:11297:x1875232130397952:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 905us (7932us total) trans 0 rc 301/301 00000100:00100000:0.0:1788360938.567187:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:2.0:1788360938.575068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360938.575176:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130398208 00000100:00100000:3.0:1788360938.575187:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130398208 00000100:00100000:3.0:1788360938.575254:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 140 00000100:00100000:3.0:1788360938.575264:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:11297:x1875232130398208:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:3.0:1788360938.575329:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360938.575357:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d661053c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e20d expref: 14 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.575375:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:3.0:1788360938.575386:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360938.575943:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.575958:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3c6 expref: 5 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.575966:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.576000:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3c6 expref: 5 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.576015:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3c6 expref: 5 pid: 5799 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360938.576029:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144031872:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360938.582875:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788360938.585554:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144031872:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788360938.585557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:2.0:1788360938.585583:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360938.585628:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130398336 00000100:00100000:3.0:1788360938.585636:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130398336 00010000:00010000:3.0:1788360938.585669:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3c6 expref: 6 pid: 5799 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360938.585737:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:3.0:1788360938.585748:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2350:x1875232130398336:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360938.585763:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360938.585770:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3c6 expref: 6 pid: 5799 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.585804:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3c6 expref: 6 pid: 5799 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.585826:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610b94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3c6 expref: 6 pid: 5799 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.585842:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:3.0:1788360938.585847:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.585856:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.585863:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.585888:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360938.585936:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2350:x1875232130398336:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 190us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360938.585944:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00010000:00010000:2.0:1788360938.586182:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.586191:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.586212:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.586222:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.586239:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360938.587479:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788360938.587493:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.587502:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.587509:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.587516:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360938.587520:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.587530:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.587545:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bf200) 00010000:00010000:2.0:1788360938.587549:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360938.587553:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.587561:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610bd3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360938.587580:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8b36393 reply state 00000000628925f1 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360938.587600:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788360938.587681:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:11297:x1875232130398208:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 12415us (12620us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788360938.587689:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 140 00010000:00010000:3.0:1788360938.590931:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.590947:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.590956:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.590975:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360938.590979:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.590987:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.591004:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a8aa8ee1600) 00010000:00010000:3.0:1788360938.591008:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360938.591013:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.591018:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bda lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360938.656555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.656809:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130398464 00000100:00100000:2.0:1788360938.656819:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130398464 00000100:00100000:2.0:1788360938.656874:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:2.0:1788360938.656884:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+14:11305:x1875232130398464:12345-192.168.203.60@tcp:101:lctl.0 00010000:00010000:2.0:1788360938.656907:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360938.656930:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610be1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.656993:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610be8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.657007:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610be8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.657019:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610be8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360938.657077:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788360938.657081:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360938.657161:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610be8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.657186:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610be1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3db expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.657216:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610be8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3db expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.657224:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1300) 00010000:00010000:2.0:1788360938.657227:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788360938.657231:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f400, rc 0) 00000100:00100000:2.0:1788360938.657292:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:11305:x1875232130398464:12345-192.168.203.60@tcp:101:lctl.0 Request processed in 409us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360938.657299:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:0.0:1788360938.723273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.723385:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130398592 00000100:00100000:2.0:1788360938.723395:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130398592 00000100:00100000:2.0:1788360938.723456:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 142 00000100:00100000:2.0:1788360938.723466:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+15:11311:x1875232130398592:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788360938.723485:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360938.723505:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610bef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3e2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723568:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610bf6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723581:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723592:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723607:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723629:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723636:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723753:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610c04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723761:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723768:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360938.723809:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788360938.723813:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360938.723834:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723847:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723853:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610bf6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723860:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723865:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360938.723869:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723882:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610bf6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723893:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1300) 00010000:00010000:2.0:1788360938.723896:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360938.723900:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610bf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723907:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610bf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723919:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723925:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723931:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723936:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360938.723939:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723945:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723951:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a8aa8ee1400) 00010000:00010000:2.0:1788360938.723954:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360938.723956:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bfd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.723971:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610bfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.724001:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610bef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e2 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.724014:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e2 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.724021:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360938.724023:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788360938.724025:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:2.0:1788360938.724146:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:11311:x1875232130398592:12345-192.168.203.60@tcp:101:bash.0 Request processed in 622us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360938.724154:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 142 00000100:00100000:1.0:1788360938.730153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.730697:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130398848 00000100:00100000:2.0:1788360938.730708:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130398848 00000100:00100000:2.0:1788360938.730771:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:2.0:1788360938.730790:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:11311:x1875232130398848:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788360938.730810:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360938.730830:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610c0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3e9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.730958:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610c12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.730973:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610c12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.730998:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610c12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731049:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731057:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731064:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788360938.731619:0:5799:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788360938.731765:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731774:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731794:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731827:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610c12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731834:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610c12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731839:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610c12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731846:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360938.731856:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610c12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731865:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610c12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731877:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360938.731880:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360938.731884:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610c12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731889:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610c12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360938.731901:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa0fd74a reply state 0000000003234516 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360938.731910:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788360938.731942:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610c0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e9 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731956:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e9 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.731965:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:2.0:1788360938.731967:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360938.731970:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:2.0:1788360938.732055:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:11311:x1875232130398848:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1274us (1911us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788360938.732063:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:1.0:1788360938.736749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.737149:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130398976 00000100:00100000:2.0:1788360938.737159:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130398976 00000100:00100000:2.0:1788360938.737205:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:2.0:1788360938.737214:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2349:x1875232130398976:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788360938.737231:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360938.737250:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610c2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3f0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788360938.737275:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788360938.737295:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1788360938.737299:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360938.737309:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610c2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f0 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.737327:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610c2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f0 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.737341:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:2.0:1788360938.737401:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2349:x1875232130398976:12345-192.168.203.60@tcp:101:bash.0 Request processed in 187us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360938.737408:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00010000:00010000:0.0:1788360938.737486:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.737496:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.737503:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.737525:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360938.737529:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.737537:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.737550:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8aa8ee1400) 00010000:00010000:0.0:1788360938.737553:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360938.737557:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.737563:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610c19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360938.741403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.741495:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130399104 00000100:00100000:2.0:1788360938.741508:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130399104 00000100:00100000:2.0:1788360938.741591:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:2.0:1788360938.741601:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:11311:x1875232130399104:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788360938.741618:0:9606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360938.741646:0:9606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3f7 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.741677:0:9606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610c2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f0 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.741686:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360938.741691:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360938.741696:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 7 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.741728:0:9606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610c2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f0 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.741742:0:9606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610c2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f0 expref: 7 pid: 6593 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360938.741757:0:9606:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9606:1875232144032000:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360938.741870:0:9606:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788360938.744204:0:9606:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9606:1875232144032000:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360938.744236:0:9606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 7 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.744256:0:9606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:2.0:1788360938.745064:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:11311:x1875232130399104:12345-192.168.203.60@tcp:101:bash.0 Request processed in 3451us (3657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360938.745112:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1788360938.745242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.745716:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130399232 00000100:00100000:2.0:1788360938.745724:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130399232 00010000:00010000:2.0:1788360938.745753:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610c2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f0 expref: 7 pid: 6593 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360938.745799:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:2.0:1788360938.745809:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130399232:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360938.745823:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360938.745845:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610c2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f0 expref: 7 pid: 6593 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.745858:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610c2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f0 expref: 7 pid: 6593 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.745879:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610c2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f0 expref: 7 pid: 6593 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.745894:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360938.745897:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360938.745904:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 6 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.745913:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 6 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.745960:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 6 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360938.745972:0:5782:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5782:1875232144032128:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788360938.746457:0:5782:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788360938.748329:0:5782:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5782:1875232144032128:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788360938.748352:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360938.748399:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130399232:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 2590us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360938.748410:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:3.0:1788360938.749728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360938.749832:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130399488 00000100:00100000:1.0:1788360938.749840:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130399488 00000100:00100000:1.0:1788360938.749928:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788360938.749937:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:11311:x1875232130399488:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:1.0:1788360938.750601:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:11311:x1875232130399488:12345-192.168.203.60@tcp:35:bash.0 Request processed in 663us (875us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788360938.750609:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788360938.808395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.808525:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130399744 00000100:00100000:2.0:1788360938.808536:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130399744 00000100:00100000:2.0:1788360938.808599:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:2.0:1788360938.808609:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:11321:x1875232130399744:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360938.808633:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360938.808654:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610c3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e3fe expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360938.808761:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788360938.808888:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610c3c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3fe expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.808903:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1300) 00010000:00010000:2.0:1788360938.808906:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788360938.808924:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610c3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3fe expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.808938:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:2.0:1788360938.809003:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:11321:x1875232130399744:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 395us (617us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788360938.809010:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:3.0:1788360938.812142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360938.812282:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130400000 00000100:00100000:0.0:1788360938.812291:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130400000 00000100:00100000:0.0:1788360938.812347:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1788360938.812357:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:11321:x1875232130400000:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788360938.812635:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:11321:x1875232130400000:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 278us (500us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788360938.812645:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:3.0:1788360938.876645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.876808:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130400128 00000100:00100000:2.0:1788360938.876818:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130400128 00000100:00100000:2.0:1788360938.876877:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:2.0:1788360938.876886:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:11327:x1875232130400128:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360938.876910:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360938.876930:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610c4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e405 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.877029:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610c51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.877044:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.877066:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360938.877158:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788360938.877162:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360938.877183:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.877208:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610c4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e405 expref: 23 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.877232:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610c51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e405 expref: 22 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.877241:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360938.877244:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788360938.877247:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f800, rc 0) 00000100:00100000:2.0:1788360938.877701:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:11327:x1875232130400128:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 814us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360938.877709:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:2.0:1788360938.884269:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360938.884418:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130400384 00000100:00100000:1.0:1788360938.884428:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130400384 00000100:00100000:1.0:1788360938.884473:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 146 00000100:00100000:1.0:1788360938.884481:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:11327:x1875232130400384:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360938.884510:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360938.884529:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d6610c58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e40c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360938.884627:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360938.884641:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360938.884653:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360938.884664:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788360938.884804:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d6610c58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e40c expref: 25 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360938.884841:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e40c expref: 24 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360938.884849:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:1.0:1788360938.884852:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360938.884856:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b000, rc 0) 00000100:00100000:1.0:1788360938.884915:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:11327:x1875232130400384:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 434us (655us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788360938.884923:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 146 00000100:00100000:3.0:1788360938.892446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360938.892609:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130400640 00000100:00100000:0.0:1788360938.892628:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130400640 00000100:00100000:0.0:1788360938.892697:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:0.0:1788360938.892707:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:11327:x1875232130400640:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360938.892729:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360938.892755:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e413 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.892859:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610c74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.892873:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.892884:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360938.892897:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788360938.893010:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e413 expref: 27 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.893029:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610c74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e413 expref: 26 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.893037:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:0.0:1788360938.893040:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788360938.893043:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42400, rc 0) 00000100:00100000:0.0:1788360938.893142:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:11327:x1875232130400640:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 436us (705us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788360938.893149:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:1.0:1788360938.898464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.898590:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130400768 00000100:00100000:2.0:1788360938.898601:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130400768 00000100:00100000:2.0:1788360938.899677:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1788360938.899705:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:2349:x1875232130400768:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360938.899723:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360938.899749:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e40c expref: 26 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.899768:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:2.0:1788360938.899773:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360938.899845:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+25:2349:x1875232130400768:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 157us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360938.899854:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788360938.902587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360938.902681:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130400896 00000100:00100000:3.0:1788360938.902700:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130400896 00000100:00100000:3.0:1788360938.902757:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788360938.902767:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130400896:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:3.0:1788360938.902817:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.902838:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 6 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.902864:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788360938.902868:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788360938.902873:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.902922:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 6 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.902936:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 6 pid: 9606 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360938.902952:0:6592:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6592:1875232144032256:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788360938.903039:0:6592:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360938.905981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360938.906060:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130401024 00000100:00100000:0.0:1788360938.906070:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130401024 00002000:00100000:0.0:1788360938.906157:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a8a89267b80 x1875232130401024/t0(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:754/0 lens 504/0 e 0 to 0 dl 1788360949 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788360938.906168:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89267b80 with x1875232130401024 ext(0->12) 00010000:00010000:0.0:1788360938.906191:0:6600:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 7 pid: 9606 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.906207:0:6600:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 7 pid: 9606 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788360938.906216:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8a89267b80 00000100:00100000:0.0:1788360938.906243:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1788360938.906252:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130401024:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:0.0:1788360938.907202:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2349:x1875232130401024:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 945us (1225us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788360938.907212:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00002000:00100000:0.0:1788360938.907221:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a8a89267b80 x1875232130401024/t4294967305(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:754/0 lens 504/448 e 0 to 0 dl 1788360949 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788360938.907231:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89267b80 with x1875232130401024 ext(0->12) 00010000:00010000:0.0:1788360938.907238:0:6600:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 9 pid: 9606 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.907254:0:6600:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 9 pid: 9606 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788360938.907261:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8a89267b80 00000100:00100000:1.0:1788360938.907485:0:6592:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6592:1875232144032256:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360938.907518:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360938.912572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.912701:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130401152 00000100:00100000:2.0:1788360938.912712:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130401152 00010000:00010000:2.0:1788360938.912764:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 9 pid: 9606 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360938.912817:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:2.0:1788360938.912826:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2351:x1875232130401152:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360938.912845:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788360938.912866:0:5783:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788360938.912869:0:5783:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788360939 00002000:00010000:2.0:1788360938.912876:0:5783:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788360939 00002000:00010000:2.0:1788360938.912878:0:5783:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788360939 00010000:00010000:2.0:1788360938.912884:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 9 pid: 9606 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.912897:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 9 pid: 9606 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.912918:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d6610c35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3f7 expref: 9 pid: 9606 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.912934:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788360938.912938:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788360938.912943:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.912954:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.912999:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788360938.913117:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.913127:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.913157:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.913165:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.913173:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.913181:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788360938.913185:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.913194:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.913207:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.913214:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d6610c82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360938.913619:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2351:x1875232130401152:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 791us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360938.913628:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:0.0:1788360938.913695:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130400896:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 10929us (11117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360938.913703:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788360938.916159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360938.916244:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130401408 00000100:00100000:0.0:1788360938.916255:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130401408 00000100:00100000:0.0:1788360938.916321:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788360938.916331:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84eaac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+25:11327:x1875232130401408:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:0.0:1788360938.916394:0:5801:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610c74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e413 expref: 25 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788360938.916630:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788360938.916674:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788360938.917227:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788360938.917286:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.917302:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e9 expref: 29 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.917310:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.917344:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e9 expref: 29 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360938.917359:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e9 expref: 29 pid: 5799 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360938.917374:0:5801:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a47480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1875232144032384:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360938.917455:0:5801:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8376e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788360938.920335:0:5801:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a47480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1875232144032384:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360938.920384:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360938.926019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.926254:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130401536 00000100:00100000:2.0:1788360938.926266:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130401536 00010000:00010000:2.0:1788360938.926313:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e9 expref: 30 pid: 5799 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360938.926346:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1788360938.926355:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+30:2349:x1875232130401536:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360938.926369:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360938.926375:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e9 expref: 30 pid: 5799 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.926388:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e9 expref: 30 pid: 5799 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.926411:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610c20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e9 expref: 30 pid: 5799 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.926425:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:2.0:1788360938.926430:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.926440:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.926459:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360938.926495:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360938.926550:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:2349:x1875232130401536:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 195us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360938.926558:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00010000:00010000:1.0:1788360938.926803:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360938.926812:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788360938.926935:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788360938.927179:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788360938.927287:0:5801:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89871b2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144032512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788360938.927348:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360938.927855:0:5801:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788360938.928613:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144032512 00000100:00100000:0.0:1788360938.928622:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144032512 00000100:00100000:0.0:1788360938.928717:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788360938.928726:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1875232144032512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788360938.928873:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1875232144032512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360938.928881:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788360938.929564:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788360938.929641:0:5801:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89871b2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144032512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788360938.930382:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788360938.930461:0:5801:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144032640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788360938.930511:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360938.930592:0:5801:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788360938.930640:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144032640 00000100:00100000:0.0:1788360938.930646:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144032640 00000100:00100000:0.0:1788360938.930729:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788360938.930738:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1875232144032640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788360938.930921:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5801:x1875232144032640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 183us (408us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788360938.930930:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788360938.931000:0:5801:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144032640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788360938.931061:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788360938.931143:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.931154:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.931162:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.931169:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360938.931173:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.931181:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.931196:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:3.0:1788360938.931200:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788360938.931204:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360938.931210:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d6610c89 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788360938.931393:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788360938.931494:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788360938.931505:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328946418467ns, next at 329946416335ns, rc = 0 00000001:00080000:3.0:1788360938.931512:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788360938.931540:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:3.0:1788360938.931544:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788360938.931550:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6610c74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e413 expref: 33 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360938.931653:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84eaac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:11327:x1875232130401408:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 15324us (15502us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788360938.931661:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000020:00080000:3.0:1788360938.931665:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788360938.934669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360938.934749:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130401664 00000100:00100000:1.0:1788360938.934759:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130401664 00000100:00100000:1.0:1788360938.934830:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:1.0:1788360938.934839:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:11327:x1875232130401664:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360938.934862:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360938.934884:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610c90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e41a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360938.934943:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e41a expref: 33 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360938.934958:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e41a expref: 33 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360938.934976:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:1.0:1788360938.934979:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788360938.934982:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a000, rc 0) 00000100:00100000:1.0:1788360938.935041:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+33:11327:x1875232130401664:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 203us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360938.935058:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:1.0:1788360938.939063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360938.939259:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130401920 00000100:00100000:2.0:1788360938.939277:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130401920 00000100:00100000:2.0:1788360938.939337:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1788360938.939347:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+33:11327:x1875232130401920:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788360938.939863:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:11327:x1875232130401920:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 516us (818us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788360938.939872:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:1.0:1788360939.012491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360939.012580:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130402176 00000100:00100000:0.0:1788360939.012590:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130402176 00000100:00100000:0.0:1788360939.012656:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:0.0:1788360939.012666:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:11337:x1875232130402176:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360939.012688:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360939.012706:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610c97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e421 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360939.012818:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788360939.012931:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610c97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e421 expref: 36 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.012957:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1300) 00010000:00010000:0.0:1788360939.012960:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788360939.012965:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d6610c97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e421 expref: 36 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.012980:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43e00, rc 0) 00000100:00100000:0.0:1788360939.013046:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:11337:x1875232130402176:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 382us (563us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788360939.013054:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00080000:1.0:1788360939.013537:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360939.017946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360939.018063:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130402304 00000100:00100000:1.0:1788360939.018075:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130402304 00000100:00100000:1.0:1788360939.018166:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 150 00000100:00100000:1.0:1788360939.018176:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:11337:x1875232130402304:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:1.0:1788360939.018270:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ca5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018287:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018301:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018316:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018323:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018330:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018436:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018445:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018453:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788360939.018494:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018508:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018535:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ca5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018542:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018548:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360939.018551:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018559:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018571:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:1.0:1788360939.018574:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360939.018578:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ca5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018584:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d6610ca5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018596:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018602:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610cac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018606:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018611:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360939.018619:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018625:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610cac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018632:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8abc8ce000) 00010000:00010000:1.0:1788360939.018634:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360939.018637:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610cac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018642:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6610cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018656:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018662:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018668:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018673:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705bc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360939.018676:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018682:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018690:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:1.0:1788360939.018692:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360939.018702:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.018707:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360939.018798:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:11337:x1875232130402304:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 622us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360939.018806:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 150 00000100:00100000:3.0:1788360939.022390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360939.022561:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130402560 00000100:00100000:1.0:1788360939.022570:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130402560 00000100:00100000:1.0:1788360939.022621:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:1.0:1788360939.022630:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:11337:x1875232130402560:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788360939.022922:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:11337:x1875232130402560:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 291us (537us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788360939.022930:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:2.0:1788360939.063017:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360939.063114:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130402816 00000100:00100000:0.0:1788360939.063124:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130402816 00000100:00100000:0.0:1788360939.063185:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:0.0:1788360939.063195:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:11340:x1875232130402816:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360939.063219:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360939.063241:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d6610cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e428 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063317:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610cc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063332:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063343:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063359:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063380:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063386:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063541:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063551:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063558:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360939.063569:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788360939.063670:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063678:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610cc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063684:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063691:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360939.063695:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063702:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610cc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063726:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:0.0:1788360939.063729:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360939.063733:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610cc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063740:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610cc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063753:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063760:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063766:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063771:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360939.063774:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063789:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063797:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8a983bf000) 00010000:00010000:0.0:1788360939.063800:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360939.063803:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610cc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063809:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063863:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d6610cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e428 expref: 39 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063877:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e428 expref: 38 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.063885:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:0.0:1788360939.063887:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788360939.063889:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43a00, rc 0) 00000100:00100000:0.0:1788360939.063953:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+38:11340:x1875232130402816:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 758us (946us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788360939.063961:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:0.0:1788360939.067144:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360939.068526:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130402944 00000100:00100000:1.0:1788360939.068540:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130402944 00000100:00100000:1.0:1788360939.068753:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00100000:1.0:1788360939.068765:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+38:11340:x1875232130402944:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:1.0:1788360939.068845:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.068864:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.068875:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.068900:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.068921:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.068928:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.068934:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705bc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360939.068938:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.068946:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.068957:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:1.0:1788360939.068960:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788360939.068964:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.068970:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6610cdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360939.069126:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+38:11340:x1875232130402944:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 362us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360939.069135:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00100000:3.0:1788360939.073263:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360939.075477:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130403200 00000100:00100000:1.0:1788360939.075491:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130403200 00000100:00100000:1.0:1788360939.075564:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:1.0:1788360939.075574:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+38:11340:x1875232130403200:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788360939.075813:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+39:11340:x1875232130403200:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 240us (2558us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788360939.075837:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00010000:00010000:0.0:1788360939.233882:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360939.358878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360939.358968:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130403456 00000100:00100000:0.0:1788360939.358979:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130403456 00000100:00100000:0.0:1788360939.359056:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:0.0:1788360939.359066:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+39:11372:x1875232130403456:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:0.0:1788360939.359118:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360939.359139:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610ce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e42f expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.359235:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610ceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.359249:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.359277:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360939.359288:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788360939.359411:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e42f expref: 42 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.359429:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e42f expref: 41 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.359437:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:0.0:1788360939.359440:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788360939.359444:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42a00, rc 0) 00000100:00100000:0.0:1788360939.359512:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:11372:x1875232130403456:12345-192.168.203.60@tcp:101:cat.0 Request processed in 447us (643us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788360939.359519:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:0.0:1788360939.364208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360939.364331:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130403584 00000100:00100000:2.0:1788360939.364342:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130403584 00000100:00100000:2.0:1788360939.364412:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788360939.364422:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:2350:x1875232130403584:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360939.364438:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360939.364464:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610ceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e42f expref: 41 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.364496:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:2.0:1788360939.364502:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360939.364569:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+40:2350:x1875232130403584:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 147us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360939.364577:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788360939.364995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360939.365073:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130403840 00000100:00100000:2.0:1788360939.365079:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130403840 00000100:00100000:2.0:1788360939.365140:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:2.0:1788360939.365148:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+40:11372:x1875232130403840:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:2.0:1788360939.365375:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:11372:x1875232130403840:12345-192.168.203.60@tcp:35:cat.0 Request processed in 227us (380us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788360939.365383:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788360939.437283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360939.437601:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130404096 00000100:00100000:3.0:1788360939.437612:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130404096 00000100:00100000:3.0:1788360939.437675:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 154 00000100:00100000:3.0:1788360939.437685:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:11378:x1875232130404096:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1788360939.437707:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360939.437722:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788360939.437749:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610c51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e405 expref: 41 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.437770:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788360939.437786:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360939.437800:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610cf9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e436 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.437901:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.437934:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e428 expref: 41 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.437942:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.437975:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e428 expref: 41 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.437989:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e428 expref: 41 pid: 6736 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360939.438002:0:5798:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89265180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1875232144032768:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788360939.438140:0:5798:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788360939.441312:0:5798:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89265180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1875232144032768:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360939.441339:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360939.441889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360939.442080:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130404224 00000100:00100000:2.0:1788360939.442131:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130404224 00010000:00010000:2.0:1788360939.442166:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e428 expref: 42 pid: 6736 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360939.442201:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:2.0:1788360939.442211:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+42:2350:x1875232130404224:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360939.442225:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360939.442232:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e428 expref: 42 pid: 6736 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.442243:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e428 expref: 42 pid: 6736 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.442265:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d6610ccf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e428 expref: 42 pid: 6736 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.442301:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:2.0:1788360939.442306:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.442315:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.442323:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.442351:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360939.442372:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.442383:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360939.442402:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:2350:x1875232130404224:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 191us (515us total) trans 0 rc 0/0 00000004:00200000:3.0:1788360939.442405:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:2.0:1788360939.442423:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00010000:00010000:3.0:1788360939.442561:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610cf9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e436 expref: 42 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.442591:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e436 expref: 41 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.442599:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:3.0:1788360939.442602:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788360939.442605:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f200, rc 0) 00000100:00100000:3.0:1788360939.442658:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:11378:x1875232130404096:12345-192.168.203.60@tcp:101:dd.0 Request processed in 4968us (5379us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788360939.442666:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 154 00000100:00100000:1.0:1788360939.446817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360939.446963:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130404480 00000100:00100000:0.0:1788360939.446974:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130404480 00000100:00100000:0.0:1788360939.447037:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 155 00000100:00100000:0.0:1788360939.447055:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:11378:x1875232130404480:12345-192.168.203.60@tcp:36:dd.0 00010000:00010000:0.0:1788360939.447363:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.447379:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.447391:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788360939.447470:0:6736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788360939.447496:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cdaff092 reply state 000000004e97f210 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360939.447505:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788360939.447594:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+44:11378:x1875232130404480:12345-192.168.203.60@tcp:36:dd.0 Request processed in 548us (785us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788360939.447602:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 155 00000020:00080000:0.0:1788360939.447606:0:6736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788360939.457564:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.457584:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.457592:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.457598:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360939.457603:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.457612:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.457630:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:3.0:1788360939.457633:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360939.457638:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.457659:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610d0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360939.756254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360939.756639:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130404608 00000100:00100000:2.0:1788360939.756649:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130404608 00000100:00100000:2.0:1788360939.756832:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 156 00000100:00100000:2.0:1788360939.756844:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+43:11392:x1875232130404608:12345-192.168.203.60@tcp:101:stat.0 00010000:00010000:2.0:1788360939.756869:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360939.756893:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610d15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e43d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.756961:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610d1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.756978:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610d1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.756991:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610d1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.757021:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610d23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.757028:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.757035:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.757176:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.757189:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e436 expref: 44 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.757197:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.757231:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e436 expref: 44 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.757246:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e436 expref: 44 pid: 5798 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360939.757260:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144032896:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360939.757368:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7300 going to sleep for 11 seconds 00000100:00100000:2.0:1788360939.762979:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144032896:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360939.763016:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360939.771721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360939.772880:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130404864 00000100:00100000:2.0:1788360939.772892:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130404864 00000100:00100000:2.0:1788360939.772956:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:2.0:1788360939.772966:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+45:5559:x1875232130404864:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788360939.773416:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+46:5559:x1875232130404864:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 450us (1704us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788360939.773424:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:0.0:1788360939.780672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360939.780849:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130404992 00000100:00100000:1.0:1788360939.780859:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130404992 00010000:00010000:1.0:1788360939.780896:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e436 expref: 46 pid: 5798 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360939.780940:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:1.0:1788360939.780949:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+46:2350:x1875232130404992:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360939.780966:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360939.780972:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e436 expref: 46 pid: 5798 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.780985:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e436 expref: 46 pid: 5798 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.781007:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610d00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e436 expref: 46 pid: 5798 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.781024:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:1.0:1788360939.781029:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.781067:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.781076:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360939.781146:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360939.781203:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+45:2350:x1875232130404992:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 255us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360939.781212:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00010000:00010000:0.0:1788360939.781724:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781735:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360939.781795:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788360939.781800:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788360939.781827:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781839:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781849:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610d1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781856:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610d1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781862:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610d1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781876:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360939.781880:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610d1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781888:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610d1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781901:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:0.0:1788360939.781903:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360939.781907:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610d1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781914:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610d1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781925:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781931:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610d23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781936:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610d23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781940:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360939.781943:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610d23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781949:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610d23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781967:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8aa8ee1100) 00010000:00010000:0.0:1788360939.781969:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360939.781973:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610d23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.781978:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610d23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.782019:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610d15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e43d expref: 45 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.782033:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e43d expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.782479:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:0.0:1788360939.782482:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788360939.782484:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:0.0:1788360939.782536:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+44:11392:x1875232130404608:12345-192.168.203.60@tcp:101:stat.0 Request processed in 25694us (26293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360939.782544:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 156 00000100:00100000:0.0:1788360939.848132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360939.848259:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130405248 00000100:00100000:2.0:1788360939.848270:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130405248 00000100:00100000:2.0:1788360939.848328:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 157 00000100:00100000:2.0:1788360939.848338:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+44:11398:x1875232130405248:12345-192.168.203.60@tcp:36:truncate.0 00010000:00010000:2.0:1788360939.848394:0:6736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360939.848422:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e43d expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.848441:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:2.0:1788360939.848446:0:6736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788360939.848635:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.848649:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360939.848659:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788360939.848840:0:6736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788360939.848884:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050b3b30b reply state 000000002efc2612 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360939.848894:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788360939.849037:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+46:11398:x1875232130405248:12345-192.168.203.60@tcp:36:truncate.0 Request processed in 698us (951us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788360939.849045:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 157 00000020:00080000:2.0:1788360939.849050:0:6736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788360939.855575:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.855593:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.855601:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.855623:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360939.855628:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.855635:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.855652:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:0.0:1788360939.855654:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360939.855659:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360939.855665:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610d31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360939.966462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360939.967846:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130405376 00000100:00100000:3.0:1788360939.967861:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130405376 00000100:00100000:3.0:1788360939.967978:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:3.0:1788360939.967990:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+45:11412:x1875232130405376:12345-192.168.203.60@tcp:101:stat.0 00010000:00010000:3.0:1788360939.968018:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360939.968056:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610d38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e444 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968143:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610d3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968160:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968173:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968187:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968194:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968199:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968463:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968486:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968494:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360939.968533:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788360939.968537:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788360939.968560:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968571:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968580:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968586:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610d3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968592:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610d3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968598:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360939.968602:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610d3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968609:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610d3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968621:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788360939.968630:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360939.968634:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610d3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968640:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610d3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968654:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968660:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968666:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968671:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360939.968674:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968679:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968747:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8a83c0bd00) 00010000:00010000:3.0:1788360939.968749:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360939.968752:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968757:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968800:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610d38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e444 expref: 47 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968830:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e444 expref: 46 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360939.968838:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:3.0:1788360939.968840:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788360939.968843:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f400, rc 0) 00000100:00100000:3.0:1788360939.968913:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+46:11412:x1875232130405376:12345-192.168.203.60@tcp:101:stat.0 Request processed in 925us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360939.968920:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:1.0:1788360940.034798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.035063:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130405632 00000100:00100000:3.0:1788360940.035073:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130405632 00000100:00100000:3.0:1788360940.035905:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:3.0:1788360940.035920:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+46:11422:x1875232130405632:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360940.035940:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360940.035961:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610d54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e44b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360940.036111:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788360940.036226:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610d54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e44b expref: 48 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.036241:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1300) 00010000:00010000:3.0:1788360940.036244:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788360940.036249:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610d54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e44b expref: 48 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.036297:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:3.0:1788360940.036639:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+47:11422:x1875232130405632:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 722us (1849us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788360940.036647:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:1.0:1788360940.043338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.043442:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130405888 00000100:00100000:3.0:1788360940.043452:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130405888 00000100:00100000:3.0:1788360940.043524:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:3.0:1788360940.043537:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+47:11422:x1875232130405888:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788360940.043840:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+48:11422:x1875232130405888:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 303us (511us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788360940.043850:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1788360940.111727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.112476:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130406144 00000100:00100000:2.0:1788360940.112487:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130406144 00000100:00100000:2.0:1788360940.112549:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 160 00000100:00100000:0.0:1788360940.112685:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+48:11428:x1875232130406144:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788360940.112711:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360940.112732:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610d62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e452 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.112841:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.112856:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e444 expref: 49 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.112864:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.112913:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e444 expref: 49 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.112927:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e444 expref: 49 pid: 5798 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360940.112941:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbd3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144033024:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360940.113026:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8376e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788360940.114982:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbd3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144033024:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360940.115009:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360940.115959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360940.116052:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130406272 00000100:00100000:1.0:1788360940.116060:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130406272 00010000:00010000:1.0:1788360940.116126:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e444 expref: 50 pid: 5798 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360940.116168:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:1.0:1788360940.116178:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+50:2349:x1875232130406272:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360940.116192:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360940.116199:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e444 expref: 50 pid: 5798 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.116211:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e444 expref: 50 pid: 5798 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.116235:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610d4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e444 expref: 50 pid: 5798 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.116265:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:1.0:1788360940.116270:0:7487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.116278:0:7487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.116286:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.116317:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360940.116383:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+49:2349:x1875232130406272:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 207us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360940.116391:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00010000:00010000:0.0:1788360940.116656:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.116665:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360940.116681:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788360940.116858:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610d62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e452 expref: 50 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.116875:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e452 expref: 49 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.116882:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:0.0:1788360940.116892:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788360940.116895:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42e00, rc 0) 00000100:00100000:0.0:1788360940.116936:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+49:11428:x1875232130406144:12345-192.168.203.60@tcp:101:bash.0 Request processed in 4378us (5218us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788360940.116944:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 160 00000100:00100000:0.0:1788360940.125858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.125977:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130406528 00000100:00100000:2.0:1788360940.125988:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130406528 00000100:00100000:2.0:1788360940.126125:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 161 00000100:00100000:2.0:1788360940.126135:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+49:11428:x1875232130406528:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:2.0:1788360940.128662:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.128686:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.128699:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788360940.130737:0:6736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788360940.131884:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8f7508d reply state 0000000098d0c178 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360940.131900:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788360940.132103:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:11428:x1875232130406528:12345-192.168.203.60@tcp:36:bash.0 Request processed in 5954us (6240us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788360940.132133:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 161 00000020:00080000:2.0:1788360940.132139:0:6736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788360940.136999:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.137017:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.137024:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.137031:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360940.137036:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.137045:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.137062:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:3.0:1788360940.137081:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360940.137137:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.137145:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360940.141427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.141745:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130406656 00000100:00100000:3.0:1788360940.141755:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130406656 00000100:00100000:3.0:1788360940.141822:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:3.0:1788360940.141832:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+51:11428:x1875232130406656:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788360940.141858:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360940.141880:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610d7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e459 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.141962:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.141977:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e452 expref: 52 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.141986:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.142022:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e452 expref: 52 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.142035:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e452 expref: 52 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360940.142077:0:5798:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89266300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1875232144033152:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788360940.142503:0:5798:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83f116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360940.150036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.150137:0:5798:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89266300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1875232144033152:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360940.150172:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360940.150449:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130406784 00000100:00100000:2.0:1788360940.150457:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130406784 00010000:00010000:2.0:1788360940.150496:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e452 expref: 53 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360940.150541:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1788360940.150552:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+53:2350:x1875232130406784:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360940.150568:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360940.150575:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e452 expref: 53 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.150587:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e452 expref: 53 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.150610:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610d69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e452 expref: 53 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.150626:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:2.0:1788360940.150631:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.150641:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.150649:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.150690:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360940.150739:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360940.150748:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:2350:x1875232130406784:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 197us (721us total) trans 0 rc 0/0 00010000:00010000:3.0:1788360940.150751:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360940.150779:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000004:00200000:3.0:1788360940.150814:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788360940.150818:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788360940.150841:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.150875:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610d7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e459 expref: 52 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.150894:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e459 expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.150901:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:3.0:1788360940.150905:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788360940.150908:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fa00, rc 0) 00000100:00100000:3.0:1788360940.150938:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+51:11428:x1875232130406656:12345-192.168.203.60@tcp:101:bash.0 Request processed in 9108us (9520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360940.150952:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:1.0:1788360940.156471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.156553:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130407040 00000100:00100000:2.0:1788360940.156562:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130407040 00000100:00100000:2.0:1788360940.156620:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:2.0:1788360940.156630:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+51:11428:x1875232130407040:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1788360940.156889:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:11428:x1875232130407040:12345-192.168.203.60@tcp:35:bash.0 Request processed in 260us (426us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788360940.156897:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000001:00080000:0.0:1788360940.236581:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1788360940.236598:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1788360940.247719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.247888:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130407296 00000100:00100000:3.0:1788360940.247903:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130407296 00000100:00100000:3.0:1788360940.247968:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:3.0:1788360940.247979:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:11438:x1875232130407296:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360940.248005:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360940.248027:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610d8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e460 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360940.248180:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788360940.248327:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610d8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e460 expref: 54 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.248343:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1300) 00010000:00010000:3.0:1788360940.248346:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788360940.248351:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610d8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e460 expref: 54 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.248364:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:3.0:1788360940.248495:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+53:11438:x1875232130407296:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 443us (713us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1788360940.248503:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:0.0:1788360940.252807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.252899:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130407424 00000100:00100000:2.0:1788360940.252909:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130407424 00000100:00100000:2.0:1788360940.252970:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 164 00000100:00100000:2.0:1788360940.252979:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+53:11438:x1875232130407424:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788360940.253057:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253074:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253119:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253131:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610da1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253136:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253149:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253237:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253243:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253248:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360940.253287:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253299:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253306:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253313:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253318:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360940.253322:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253330:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253342:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360940.253350:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360940.253355:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253361:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610d9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253375:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253381:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610da1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253387:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253392:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360940.253395:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253402:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610da1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253410:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788360940.253412:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360940.253427:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610da1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253432:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610da1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253448:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253460:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253466:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253471:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360940.253474:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253480:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253487:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:2.0:1788360940.253490:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360940.253492:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.253497:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610da8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360940.253560:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+53:11438:x1875232130407424:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 582us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360940.253567:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 164 00010000:00010000:0.0:1788360940.256331:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360940.256985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.257073:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130407680 00000100:00100000:2.0:1788360940.257098:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130407680 00000100:00100000:2.0:1788360940.257193:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:2.0:1788360940.257204:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+53:11438:x1875232130407680:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788360940.257435:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:11438:x1875232130407680:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 231us (453us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788360940.257453:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1788360940.286975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.287380:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130407936 00000100:00100000:2.0:1788360940.287390:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130407936 00000100:00100000:2.0:1788360940.287484:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:2.0:1788360940.287495:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:11441:x1875232130407936:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360940.287518:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360940.287539:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610daf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e467 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287614:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610db6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287629:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287640:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287653:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610dbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287660:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287667:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287801:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287829:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287836:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360940.287847:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788360940.287944:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287952:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610db6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287959:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287964:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360940.287968:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287976:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610db6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.287990:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360940.287993:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360940.287998:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610db6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288005:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610db6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288019:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288035:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610dbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288224:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288229:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360940.288232:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288239:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610dbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288246:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788360940.288249:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360940.288251:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610dbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288257:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610dbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288325:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610daf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e467 expref: 57 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288339:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e467 expref: 56 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.288345:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:2.0:1788360940.288347:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360940.288355:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:2.0:1788360940.288463:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:11441:x1875232130407936:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 969us (1496us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788360940.288471:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:0.0:1788360940.291792:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.291874:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130408064 00000100:00100000:2.0:1788360940.291884:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130408064 00000100:00100000:2.0:1788360940.291976:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:2.0:1788360940.291986:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:11441:x1875232130408064:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:2.0:1788360940.292070:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.292211:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.292225:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.292253:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.292260:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.292385:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.292391:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360940.292396:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.292404:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.292428:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:2.0:1788360940.292430:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788360940.292435:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.292441:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360940.292551:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:11441:x1875232130408064:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 566us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360940.292559:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:1.0:1788360940.294420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.294502:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130408320 00000100:00100000:3.0:1788360940.294512:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130408320 00000100:00100000:3.0:1788360940.294565:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:3.0:1788360940.294574:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:11441:x1875232130408320:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788360940.294837:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:11441:x1875232130408320:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 263us (424us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788360940.294844:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1788360940.297020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360940.297118:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130408448 00000100:00100000:1.0:1788360940.297128:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130408448 00000100:00100000:1.0:1788360940.297195:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788360940.297205:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:2349:x1875232130408448:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360940.297222:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360940.297247:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610dc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e467 expref: 57 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.297265:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:1.0:1788360940.297282:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360940.297342:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:2349:x1875232130408448:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 138us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360940.297350:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788360940.473683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.473750:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130408704 00000100:00100000:3.0:1788360940.473762:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130408704 00000100:00100000:3.0:1788360940.473838:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:3.0:1788360940.473848:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:11459:x1875232130408704:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1788360940.473877:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360940.473900:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610dd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e46e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.474010:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610de0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.474025:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.474036:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360940.474048:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788360940.474252:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610dd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e46e expref: 59 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.474272:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610de0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e46e expref: 58 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.474280:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:3.0:1788360940.474296:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788360940.474300:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ec00, rc 0) 00000100:00100000:3.0:1788360940.474357:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+58:11459:x1875232130408704:12345-192.168.203.60@tcp:101:cat.0 Request processed in 510us (681us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788360940.474365:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:3.0:1788360940.510478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360940.511309:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130408832 00000100:00100000:0.0:1788360940.511321:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130408832 00000100:00100000:0.0:1788360940.511387:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:0.0:1788360940.511397:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+58:11460:x1875232130408832:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360940.511421:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360940.511444:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610dee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e475 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.511514:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610df5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.511528:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.511556:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360940.511612:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1788360940.511617:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788360940.511639:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.511665:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610dee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e475 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.511992:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e475 expref: 59 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.512002:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:0.0:1788360940.512005:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788360940.512008:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43800, rc 0) 00000100:00100000:0.0:1788360940.513302:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:11460:x1875232130408832:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 688us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360940.513318:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:0.0:1788360940.520241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.520328:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130409216 00000100:00100000:3.0:1788360940.520338:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130409216 00000100:00100000:3.0:1788360940.520395:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:3.0:1788360940.520406:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:11460:x1875232130409216:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788360940.520780:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11460:x1875232130409216:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 368us (543us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788360940.520789:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1788360940.525133:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.525230:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130409344 00000100:00100000:2.0:1788360940.525239:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130409344 00000100:00100000:2.0:1788360940.525308:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788360940.525318:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11460:x1875232130409344:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:2.0:1788360940.525333:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788360940.525359:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e459 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.525381:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610de0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e46e expref: 59 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.525393:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610c90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e41a expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.525404:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8abc8ce200) 00010000:00010000:2.0:1788360940.525414:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360940.525490:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:11460:x1875232130409344:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 174us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360940.525499:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788360940.528697:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.529066:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130409472 00000100:00100000:2.0:1788360940.529076:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130409472 00000100:00100000:2.0:1788360940.529170:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:2.0:1788360940.529180:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:11460:x1875232130409472:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:2.0:1788360940.529310:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dfc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.529327:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dfc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.529337:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dfc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788360940.529522:0:6736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788360940.529605:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:11460:x1875232130409472:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 426us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360940.529613:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:0.0:1788360940.546661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.546841:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130409600 00000100:00100000:2.0:1788360940.546852:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130409600 00000100:00100000:2.0:1788360940.546915:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:2.0:1788360940.546924:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:11462:x1875232130409600:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360940.546943:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360940.546964:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610e03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e47c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547035:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547064:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547078:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547284:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547292:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547299:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547393:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547401:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547407:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360940.547443:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788360940.547448:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360940.547467:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547479:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547499:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547506:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547513:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547519:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360940.547523:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547531:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547543:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360940.547546:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360940.547551:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547557:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547570:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547575:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547581:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547595:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360940.547598:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547603:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547611:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8aa8ee1100) 00010000:00010000:2.0:1788360940.547613:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360940.547615:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547621:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547653:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6610e03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e47c expref: 59 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547665:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e47c expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.547672:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788360940.547674:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788360940.547675:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:2.0:1788360940.548490:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+58:11462:x1875232130409600:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1562us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360940.548500:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:2.0:1788360940.704361:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144033536:0@lo:400:kworker.0 00000100:00100000:2.0:1788360940.704463:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360940.704520:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788360940.704527:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144033664:0@lo:400:kworker.0 00000100:00100000:2.0:1788360940.704552:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360940.704590:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144033536 00000100:00100000:2.0:1788360940.704598:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144033536 00000100:00100000:2.0:1788360940.704648:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788360940.704657:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144033536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360940.704710:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144033536:12345-0@lo:400:kworker.0 Request processed in 54us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360940.704717:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1788360940.704741:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360940.704785:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144033536:0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705039:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144033280:0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705075:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360940.705121:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abcbd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144033792:0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705150:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360940.705171:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788360940.705187:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144033408:0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705210:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360940.705224:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144033920:0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705246:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360940.705276:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144033664 00000100:00100000:0.0:1788360940.705293:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144033664 00000100:00100000:0.0:1788360940.705333:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144033920 00000100:00100000:0.0:1788360940.705336:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144033920 00000100:00100000:0.0:1788360940.705360:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788360940.705367:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144033664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705409:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144033664:12345-0@lo:400:kworker.0 Request processed in 42us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360940.705511:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788360940.705526:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788360940.705533:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144033920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705575:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144033920:12345-0@lo:400:kworker.0 Request processed in 43us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360940.705581:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788360940.705600:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144033792 00000100:00100000:0.0:1788360940.705604:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144033792 00000100:00100000:0.0:1788360940.705630:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144033408 00000100:00100000:0.0:1788360940.705634:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144033408 00000100:00100000:3.0:1788360940.705635:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144033920:0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705650:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788360940.705657:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144033792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705692:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144033792:12345-0@lo:400:kworker.0 Request processed in 36us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360940.705697:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788360940.705717:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788360940.705724:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144033408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360940.705729:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abcbd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144033792:0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705765:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144033408:12345-0@lo:400:kworker.0 Request processed in 42us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360940.705783:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788360940.705808:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144033408:0@lo:400:kworker.0 00000004:00080000:0.0:1788360940.705847:0:6735:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330720760016ns, next at 331720757667ns, rc = 0 00000100:00100000:0.0:1788360940.705901:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144033280 00000100:00100000:0.0:1788360940.705905:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144033280 00000100:00100000:0.0:1788360940.705935:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788360940.705941:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144033280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.705975:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144033280:12345-0@lo:400:kworker.0 Request processed in 34us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360940.705981:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1788360940.707742:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788360940.707751:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788360940.707753:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788360940.708492:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144033280:0@lo:400:kworker.0 00000100:00100000:0.0:1788360940.710002:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788360940.710023:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144034048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360940.710107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360940.710154:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144034048 00000100:00100000:0.0:1788360940.710161:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144034048 00000100:00100000:1.0:1788360940.711409:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788360940.712396:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788360940.712499:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144033664:0@lo:400:kworker.0 00000100:00100000:1.0:1788360940.712701:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788360940.712738:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144034048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788360940.712787:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360940.712903:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144034048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360940.712911:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788360940.712987:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144034048:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788360940.778816:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:0.0:1788360940.778848:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000001:00080000:0.0:1788360940.778896:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:0.0:1788360940.778921:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:0.0:1788360940.778936:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788360940.778945:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8ac05e09c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788360940.778951:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a87cd4b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ac05e0900 00000020:00080000:0.0:1788360940.778954:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a87cd4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a835d8c00 00000100:00100000:2.0:1788360940.779160:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788360940.779179:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144034176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788360940.779246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360940.779316:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144034176 00000100:00100000:2.0:1788360940.779322:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144034176 00000100:00100000:2.0:1788360940.779363:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788360940.779372:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144034176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788360940.779399:0:6594:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1788360940.779431:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9838eb, atime: 0x6a9838eb, ctime: 0x6a9838eb, blocks: 0xb 00010000:00010000:2.0:1788360940.779440:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610e1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.779456:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1788360940.779472:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360940.779478:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610e1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.779494:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610e1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.779505:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610e1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.779512:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.779530:0:6594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788360940.780080:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144034176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 708us (833us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788360940.780114:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1788360940.780143:0:11019:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360940.780149:0:11019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.780158:0:11019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788360940.780162:0:11019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.780171:0:11019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610e1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.780199:0:11019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610e1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.780207:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d6610e1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.780225:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360940.780227:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360940.780228:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788360940.780258:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a8926d880/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788360940.780265:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144034176:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788360940.780445:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788360940.780574:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:0.0:1788360940.832355:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788360940.832378:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788360940.832429:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:0.0:1788360940.832437:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788360940.832561:0:11534:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985a60a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144034304:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788360940.832657:0:11534:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a5cfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788360940.841395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360940.841428:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130409728 00000100:00100000:0.0:1788360940.841437:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130409728 00000100:00100000:0.0:1788360940.841486:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:0.0:1788360940.841495:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:11473:x1875232130409728:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788360940.841529:0:5799:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788360940.841664:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:11473:x1875232130409728:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 169us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360940.841672:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:3.0:1788360940.842133:0:11534:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985a60a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144034304:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788360940.844498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.844618:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130409856 00000100:00100000:3.0:1788360940.844628:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130409856 00000100:00100000:3.0:1788360940.844689:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00100000:3.0:1788360940.844699:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:11473:x1875232130409856:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788360940.844795:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610e26 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.844811:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610e26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.844824:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610e26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.844840:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610e2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.844847:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610e2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.844853:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610e2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845003:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845013:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845021:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360940.845133:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788360940.845137:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788360940.845150:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845160:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610e26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845172:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610e26 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845178:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610e26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845183:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360940.845188:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610e26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845195:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610e26 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845207:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:3.0:1788360940.845210:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360940.845214:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610e26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845220:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610e26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845232:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610e2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845238:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610e2d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845243:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610e2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845248:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360940.845257:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610e2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845471:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610e2d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845480:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9a8a83c0b900) 00010000:00010000:3.0:1788360940.845483:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360940.845486:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610e2d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845493:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610e2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845508:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845513:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845520:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845525:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360940.845528:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845534:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845540:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:3.0:1788360940.845542:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360940.845552:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360940.845558:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610e34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360940.846081:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:11473:x1875232130409856:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 1379us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360940.846121:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00100000:1.0:1788360940.858634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.860234:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130410112 00000100:00100000:3.0:1788360940.860246:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130410112 00000100:00100000:2.0:1788360940.861382:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:2.0:1788360940.861396:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+16:11473:x1875232130410112:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788360940.861419:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360940.861440:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e483 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861537:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861554:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861579:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360940.861593:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788360940.861794:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861802:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861809:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861815:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360940.861819:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861827:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861839:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788360940.861842:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788360940.861846:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861851:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861890:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e3b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e483 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861912:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:2.0:1788360940.861915:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788360940.861919:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e483 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.861928:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:2.0:1788360940.861989:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:11473:x1875232130410112:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 597us (3365us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788360940.861996:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:0.0:1788360940.890869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360940.890947:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130410240 00000100:00100000:1.0:1788360940.890958:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130410240 00000100:00100000:1.0:1788360940.891019:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:1.0:1788360940.891038:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:11473:x1875232130410240:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788360940.891075:0:6736:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788360940.891238:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:11473:x1875232130410240:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 211us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360940.891246:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:3.0:1788360940.900723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.901402:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130410496 00000100:00100000:2.0:1788360940.901415:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130410496 00000100:00100000:2.0:1788360940.902138:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 175 00000100:00100000:2.0:1788360940.902152:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:11473:x1875232130410496:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788360940.902177:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360940.902180:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788360940.902210:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d6610df5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e475 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.902233:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360940.902239:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788360940.902255:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e48a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788360940.903055:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788360940.903354:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.903377:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.903389:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.903454:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e48a expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.903471:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e48a expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.903479:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:2.0:1788360940.903482:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360940.903485:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:2.0:1788360940.906493:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:11473:x1875232130410496:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 4332us (5770us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788360940.906506:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 175 00000100:00100000:0.0:1788360940.918892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360940.920033:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130410752 00000100:00100000:1.0:1788360940.920049:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130410752 00000100:00100000:1.0:1788360940.920138:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 176 00000100:00100000:1.0:1788360940.920152:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:11473:x1875232130410752:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788360940.920215:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360940.920250:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6610e57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e48a expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920269:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:1.0:1788360940.920281:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788360940.920304:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610e65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920318:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610e65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920327:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610e65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920342:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610e6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x113ad8f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920349:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610e6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x113ad8f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920356:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610e6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x113ad8f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920630:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610e65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920638:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610e65 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920644:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610e65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920650:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360940.920654:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610e65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920661:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610e65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920670:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:1.0:1788360940.920673:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360940.920676:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610e65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920683:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a000/0xf6a94c97d6610e65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920694:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610e6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x113ad8f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920700:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610e6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x113ad8f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920705:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610e6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x113ad8f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920717:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360940.920720:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610e6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x113ad8f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920726:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610e6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x113ad8f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920735:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x113ad8f2 (ffff9a8abc8ce000) 00010000:00010000:1.0:1788360940.920738:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360940.920741:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610e6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x113ad8f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.920746:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b000/0xf6a94c97d6610e6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x113ad8f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360940.920833:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:11473:x1875232130410752:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 684us (1949us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788360940.920840:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 176 00000100:00100000:0.0:1788360940.926741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360940.926926:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130410880 00000100:00100000:1.0:1788360940.926937:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130410880 00000100:00100000:1.0:1788360940.927000:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 177 00000100:00100000:1.0:1788360940.927011:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:11473:x1875232130410880:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788360940.927034:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360940.927062:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d6610e73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e491 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.927118:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.927148:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.927162:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.927264:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705be00/0xf6a94c97d6610e73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e491 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.927282:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e491 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.927291:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8abc8ce600) 00010000:00010000:1.0:1788360940.927294:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788360940.927299:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a600, rc 0) 00000100:00100000:1.0:1788360940.927361:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:11473:x1875232130410880:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 352us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360940.927367:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 177 00000100:00100000:0.0:1788360940.934588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360940.939812:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130411136 00000100:00100000:1.0:1788360940.939832:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130411136 00000100:00100000:1.0:1788360940.939945:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00100000:1.0:1788360940.939957:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:11473:x1875232130411136:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788360940.940049:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.940066:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.940113:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788360940.940453:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788360940.940463:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330955377002ns, next at 331955374727ns, rc = 0 00000004:00010000:1.0:1788360940.940539:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027139f01 reply state 00000000de154b64 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360940.940547:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788360940.940648:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:11473:x1875232130411136:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 692us (6069us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788360940.940655:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00100000:0.0:1788360940.947134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.947241:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130411264 00000100:00100000:2.0:1788360940.947250:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130411264 00000100:00100000:2.0:1788360940.947303:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00100000:2.0:1788360940.947312:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:11473:x1875232130411264:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788360940.947639:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360940.947866:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e498 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.948045:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e498 expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.951841:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.951863:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.951871:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.951947:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e498 expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.951995:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8abc8ce600) 00010000:00010000:2.0:1788360940.951999:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788360940.952002:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:2.0:1788360940.952077:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:11473:x1875232130411264:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 4764us (4952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360940.952101:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 179 00010000:00010000:1.0:1788360940.952806:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360940.952813:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.952824:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.952842:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8abc8ce600) 00010000:00010000:1.0:1788360940.952845:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788360940.952862:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.952931:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6610e81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360940.962365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.962497:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130411392 00000100:00100000:2.0:1788360940.962507:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130411392 00000100:00100000:2.0:1788360940.962611:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1788360940.962620:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130411392:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788360940.962960:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130411392:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 340us (603us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788360940.962969:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00080000:3.0:1788360940.963573:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788360940.965401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.965528:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130411648 00000100:00100000:3.0:1788360940.965538:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130411648 00000100:00100000:3.0:1788360940.965595:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788360940.965605:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:11473:x1875232130411648:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788360940.965831:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:11473:x1875232130411648:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 226us (438us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788360940.965839:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:2.0:1788360940.968792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360940.968869:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130411904 00000100:00100000:3.0:1788360940.968879:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130411904 00000100:00100000:3.0:1788360940.968933:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 180 00000100:00100000:3.0:1788360940.968943:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:11473:x1875232130411904:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788360940.969040:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:11473:x1875232130411904:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 99us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360940.969048:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 180 00000100:00100000:3.0:1788360940.972289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360940.972394:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130412032 00000100:00100000:0.0:1788360940.972404:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130412032 00000100:00100000:0.0:1788360940.972567:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:0.0:1788360940.972577:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:11473:x1875232130412032:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788360940.972598:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360940.972618:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610e8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e49f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.972718:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610e96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.972733:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.972744:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360940.972786:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788360940.972805:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.972832:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610e8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e49f expref: 23 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.972848:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e49f expref: 22 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360940.972856:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8abc8ce600) 00010000:00010000:0.0:1788360940.972859:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788360940.972862:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43600, rc 0) 00000100:00100000:0.0:1788360940.972915:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:11473:x1875232130412032:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 339us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360940.972922:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:2.0:1788360940.984570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360940.984609:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130412160 00000100:00100000:2.0:1788360940.984619:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130412160 00000100:00100000:2.0:1788360940.984666:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:2.0:1788360940.984676:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130412160:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788360940.984694:0:6594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360940.984729:0:6594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6610e9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4a6 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788360940.984756:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9838ed, blocks: 0x1 00010000:00010000:2.0:1788360940.984785:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1788360940.984790:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360940.984801:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6610e9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4a6 expref: 8 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.984818:0:6594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6610e9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4a6 expref: 8 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360940.984832:0:6594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:2.0:1788360940.984884:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2349:x1875232130412160:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 209us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360940.984891:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:3.0:1788360940.990889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360940.990961:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130412416 00000100:00100000:1.0:1788360940.990971:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130412416 00000100:00100000:1.0:1788360940.991030:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 182 00000100:00100000:1.0:1788360940.991040:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:11473:x1875232130412416:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788360940.991189:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:11473:x1875232130412416:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 150us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360940.991196:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 182 00000100:00100000:2.0:1788360940.997655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360940.998220:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130412544 00000100:00100000:0.0:1788360940.998229:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130412544 00000100:00100000:0.0:1788360940.999152:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:1.0:1788360940.999358:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898533b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:11473:x1875232130412544:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788360940.999380:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360940.999399:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4ad expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.999432:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6610e9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4a6 expref: 9 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.999441:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788360940.999445:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788360940.999450:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.999499:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6610e9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4a6 expref: 9 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360940.999521:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6610e9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4a6 expref: 9 pid: 6594 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360940.999535:0:6592:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985091180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6592:1875232144034432:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788360940.999635:0:6592:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90600 going to sleep for 11 seconds 00000100:00100000:1.0:1788360941.005864:0:6592:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985091180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6592:1875232144034432:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360941.005911:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 9 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.005934:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a800, rc 0) 00000100:00100000:1.0:1788360941.005997:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898533b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:11473:x1875232130412544:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 6821us (8350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360941.006007:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:2.0:1788360941.011743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.011794:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130412672 00000100:00100000:2.0:1788360941.011804:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130412672 00010000:00010000:2.0:1788360941.011843:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6610e9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4a6 expref: 9 pid: 6594 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.011881:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:2.0:1788360941.011890:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2349:x1875232130412672:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360941.011905:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360941.011941:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6610e9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4a6 expref: 9 pid: 6594 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.011955:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6610e9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4a6 expref: 9 pid: 6594 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.011980:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6610e9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4a6 expref: 9 pid: 6594 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.011995:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360941.012000:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360941.012009:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.012021:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.012060:0:5784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.012076:0:5784:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8493a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5784:1875232144034560:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788360941.012181:0:5784:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a882fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788360941.017254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.017326:0:5784:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8493a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5784:1875232144034560:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788360941.017353:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360941.017403:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2349:x1875232130412672:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 5513us (5668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360941.017540:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:2.0:1788360941.017682:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130412800 00000100:00100000:2.0:1788360941.017689:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130412800 00002000:00100000:2.0:1788360941.017727:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a8a84939500 x1875232130412800/t0(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:2/0 lens 504/0 e 0 to 0 dl 1788360952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788360941.017737:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a84939500 with x1875232130412800 ext(0->8) 00002000:00010000:2.0:1788360941.017742:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a84939500 00000100:00100000:2.0:1788360941.017773:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788360941.017782:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2349:x1875232130412800:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788360941.018207:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:2349:x1875232130412800:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 425us (965us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788360941.018215:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00002000:00100000:2.0:1788360941.018222:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a8a84939500 x1875232130412800/t4294967314(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:2/0 lens 504/448 e 0 to 0 dl 1788360952 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788360941.018230:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a84939500 with x1875232130412800 ext(0->8) 00002000:00010000:2.0:1788360941.018234:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a84939500 00000100:00100000:2.0:1788360941.033155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.033189:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130412928 00000100:00100000:2.0:1788360941.033198:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130412928 00000100:00100000:2.0:1788360941.033261:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 183 00000100:00100000:2.0:1788360941.033272:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:11473:x1875232130412928:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000100:00080000:2.0:1788360941.033345:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788360941.079496:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1788360941.079510:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:2.0:1788360941.079870:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:11473:x1875232130412928:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 46594us (46717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360941.079893:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 183 00000001:00080000:0.0:1788360941.088537:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1788360941.088557:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1788360941.089167:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788360941.089181:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788360941.095384:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144034688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788360941.095464:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360941.095539:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144034688 00000100:00100000:3.0:1788360941.095547:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144034688 00000100:00100000:3.0:1788360941.095593:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788360941.095601:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144034688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788360941.095750:0:6594:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788360941.095754:0:6594:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788360941 00002000:00010000:3.0:1788360941.095756:0:6594:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788360941.095759:0:6594:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788360941 -> 1788360941 00002000:00010000:3.0:1788360941.095761:0:6594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788360941.095810:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144034688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 209us (345us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788360941.095818:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1788360941.095866:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a89265c00/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788360941.095871:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144034688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788360941.096551:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360941.096617:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130413056 00000100:00100000:1.0:1788360941.096623:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130413056 00000100:00100000:1.0:1788360941.096667:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1788360941.096675:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:2349:x1875232130413056:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788360941.140434:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:2349:x1875232130413056:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 43739us (43866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360941.140449:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000001:00080000:3.0:1788360941.140980:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:3.0:1788360941.140997:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1788360941.146909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360941.147234:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130413312 00000100:00100000:1.0:1788360941.147256:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130413312 00000100:00100000:1.0:1788360941.147326:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:1.0:1788360941.147350:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:11473:x1875232130413312:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788360941.147407:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360941.147697:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d6610e96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e49f expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.147718:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8abc8ce600) 00010000:00010000:1.0:1788360941.147722:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788360941.147815:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.147832:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.147843:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788360941.148168:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e13195fd reply state 000000002816a984 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360941.148179:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788360941.148307:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:11473:x1875232130413312:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 958us (1409us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788360941.148314:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:2.0:1788360941.159079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360941.159462:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130413440 00000100:00100000:1.0:1788360941.159472:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130413440 00000100:00100000:1.0:1788360941.159532:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:1.0:1788360941.159543:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89865bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130413440:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788360941.159814:0:6594:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788360941.159818:0:6594:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788360941 -> 1788360940 00002000:00010000:1.0:1788360941.159820:0:6594:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788360939 00002000:00010000:1.0:1788360941.159823:0:6594:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788360941 -> 1788360940 00002000:00010000:1.0:1788360941.159825:0:6594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788360941.159899:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89865bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2349:x1875232130413440:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 358us (830us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788360941.159908:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00010000:00010000:0.0:1788360941.161892:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.161909:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.161916:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.161936:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360941.161940:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.161949:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.161967:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8abc8ce600) 00010000:00010000:0.0:1788360941.161971:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360941.161976:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.161982:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d6610eab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360941.171884:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.171987:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130413696 00000100:00100000:2.0:1788360941.171997:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130413696 00000100:00100000:2.0:1788360941.172115:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00100000:2.0:1788360941.172125:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:11473:x1875232130413696:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788360941.172203:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.172223:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e491 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.172233:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.172270:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e491 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.172295:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e491 expref: 18 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.172311:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f90700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144034816:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360941.172573:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360941.178190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.178509:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f90700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144034816:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360941.178536:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.179103:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130413824 00000100:00100000:3.0:1788360941.179112:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130413824 00010000:00010000:3.0:1788360941.179149:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e491 expref: 19 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.179191:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:3.0:1788360941.179200:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985091180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:2349:x1875232130413824:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360941.179214:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360941.179221:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e491 expref: 19 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.179246:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e491 expref: 19 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.180418:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d6610e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e491 expref: 19 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.180436:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8abc8ce600) 00010000:00010000:3.0:1788360941.180441:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.180451:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.180459:0:8303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.180726:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360941.180814:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985091180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:2349:x1875232130413824:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1613us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360941.180825:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00010000:00010000:3.0:1788360941.181226:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.181235:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.181267:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.181273:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.181281:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.181299:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.181303:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.181311:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.181322:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8abc8ce600) 00010000:00010000:3.0:1788360941.181325:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788360941.181329:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.181334:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610eb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.181429:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:11473:x1875232130413696:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 9304us (9553us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788360941.181438:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00100000:0.0:1788360941.200855:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360941.200964:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130413952 00000100:00100000:0.0:1788360941.200975:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130413952 00000100:00100000:0.0:1788360941.201111:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:0.0:1788360941.201123:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130413952:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788360941.201170:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.201191:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.201199:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360941.201214:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788360941.201218:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.201254:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.201269:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 8 pid: 6592 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360941.201285:0:6592:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987c49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6592:1875232144034944:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360941.201363:0:6592:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788360941.210250:0:6592:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987c49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6592:1875232144034944:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360941.210280:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.211203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360941.212141:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130414080 00000100:00100000:1.0:1788360941.212153:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130414080 00010000:00010000:1.0:1788360941.212197:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 9 pid: 6592 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360941.212236:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:1.0:1788360941.212255:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2350:x1875232130414080:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360941.212272:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360941.212306:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 9 pid: 6592 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.212321:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 9 pid: 6592 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.212345:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095b9b8f6/0xf6a94c97d6610ea4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ad expref: 9 pid: 6592 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.212363:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788360941.212367:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788360941.212374:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.212385:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.212409:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360941.212536:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130414080:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 281us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360941.212544:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00010000:00010000:2.0:1788360941.214658:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.214678:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.214851:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.214861:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.214940:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.214948:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788360941.214953:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.214963:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.215002:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.215010:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0e4d2ee/0xf6a94c97d6610eb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.215226:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130413952:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 14098us (14374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360941.215236:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:2.0:1788360941.217614:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987c4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144035072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788360941.217681:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360941.217756:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144035072 00000100:00100000:2.0:1788360941.217774:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144035072 00000100:00100000:2.0:1788360941.217818:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788360941.217827:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144035072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788360941.217848:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788360941.218152:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144035072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 325us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360941.218161:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788360941.218201:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788360941.218207:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a89265c00, transno 4294967315 00000100:00100000:2.0:1788360941.218229:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987c4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144035072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788360941.221013:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.221248:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130414336 00000100:00100000:2.0:1788360941.221258:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130414336 00000100:00100000:2.0:1788360941.221321:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 186 00000100:00100000:2.0:1788360941.221330:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+17:11473:x1875232130414336:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788360941.221410:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610ec0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.221532:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.221545:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.222273:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.222288:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e498 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.222297:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.222334:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e498 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.222348:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e498 expref: 18 pid: 5798 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.222364:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144035200:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360941.223325:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360941.226353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360941.226389:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130414464 00000100:00100000:1.0:1788360941.226406:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130414464 00010000:00010000:1.0:1788360941.226454:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e88 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e498 expref: 19 pid: 5798 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360941.226489:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:1.0:1788360941.226498:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985091880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:2350:x1875232130414464:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360941.226513:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360941.226520:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e88 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e498 expref: 19 pid: 5798 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.226533:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e498 expref: 19 pid: 5798 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.226554:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8abc8ce600) 00010000:00010000:1.0:1788360941.226560:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.226569:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.226577:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.226596:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360941.226644:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985091880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:2350:x1875232130414464:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 147us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360941.226651:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00010000:00010000:3.0:1788360941.226907:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6610e88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e498 expref: 18 pid: 5798 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.226922:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144035200:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360941.226953:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.226963:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.226970:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788360941.227169:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788360941.227300:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788360941.227342:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788360941.227533:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1875232144035328:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788360941.227580:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360941.227608:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788360941.227847:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144035328 00000100:00100000:1.0:1788360941.227853:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144035328 00000100:00100000:1.0:1788360941.227956:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788360941.227964:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1875232144035328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788360941.228050:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1875232144035328:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360941.228058:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788360941.228114:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1875232144035328:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788360941.228999:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788360941.229695:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985090380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1875232144035456:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788360941.229835:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360941.230522:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144035456 00000100:00100000:3.0:1788360941.230531:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144035456 00000100:00100000:3.0:1788360941.230582:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788360941.230592:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1875232144035456:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788360941.233837:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f909c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360941.235988:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1875232144035456:12345-0@lo:1000:mdt00_000.0 Request processed in 5391us (6146us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788360941.236015:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788360941.236206:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985090380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1875232144035456:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788360941.236254:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236264:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236273:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236279:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360941.236284:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236292:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236309:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8abc8ce600) 00010000:00010000:1.0:1788360941.236312:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788360941.236323:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236330:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610ec7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236362:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dfc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236368:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dfc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236374:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dfc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236380:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360941.236383:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dfc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236389:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dfc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236396:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:1.0:1788360941.236399:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788360941.236401:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dfc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.236407:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6610dfc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.237551:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.237574:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e47c expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.237583:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.237624:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e47c expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.237640:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e47c expref: 21 pid: 5797 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360941.237654:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987c4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144035584:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360941.238802:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788360941.243969:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987c4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144035584:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360941.244004:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360941.246805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.247010:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130414592 00000100:00100000:2.0:1788360941.247020:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130414592 00010000:00010000:2.0:1788360941.247060:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e47c expref: 22 pid: 5797 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.247120:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788360941.247130:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:2349:x1875232130414592:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360941.247151:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360941.247159:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e47c expref: 22 pid: 5797 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.247173:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e47c expref: 22 pid: 5797 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.247196:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6610e18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e47c expref: 22 pid: 5797 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.247210:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788360941.247216:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.247225:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.247231:0:8303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.247265:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360941.247317:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:2349:x1875232130414592:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 188us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360941.247325:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00010000:00010000:3.0:1788360941.247798:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247809:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247820:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247833:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247840:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247846:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.247850:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247858:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247942:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:3.0:1788360941.247946:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360941.247950:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247957:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6610ece lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247970:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247976:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610ec0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247982:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610ec0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.247987:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.247996:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610ec0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.248002:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610ec0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.248010:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:3.0:1788360941.248012:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788360941.248015:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610ec0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.248021:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610ec0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.250240:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:11473:x1875232130414336:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 28898us (29223us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788360941.250254:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 186 00000020:00080000:2.0:1788360941.250261:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788360941.258610:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788360941.258619:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788360941.259587:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788360941.259599:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788360941.259901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.261609:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130414848 00000100:00100000:2.0:1788360941.261623:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130414848 00000100:00100000:2.0:1788360941.261686:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:2.0:1788360941.261706:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:11473:x1875232130414848:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788360941.263509:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788360941.263624:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788360941.263678:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.263696:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.264207:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.264219:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.264232:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.264239:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.266969:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788360941.267591:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:11473:x1875232130414848:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 5889us (7687us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788360941.267602:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000020:00080000:2.0:1788360941.267608:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788360941.269581:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788360941.269601:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.269612:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788360941.269617:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.269626:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.269645:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:1.0:1788360941.269648:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788360941.269652:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.269658:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610ed5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360941.269677:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360941.269679:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360941.269681:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360941.280682:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788360941.351595:0:12360:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788360941.351604:0:12360:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788360941.351662:0:12360:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:3.0:1788360941.351670:0:12360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788360941.451756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.451843:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130415104 00000100:00100000:3.0:1788360941.451853:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130415104 00000100:00100000:3.0:1788360941.451911:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 187 00000100:00100000:3.0:1788360941.451920:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:11483:x1875232130415104:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360941.451944:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360941.451963:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610edc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4b4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.452240:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610ee3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.452255:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.452277:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360941.452290:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1788360941.452476:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610edc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4b4 expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.452492:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4b4 expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.452501:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788360941.452504:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788360941.452507:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fa00, rc 0) 00000100:00100000:3.0:1788360941.452673:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:11483:x1875232130415104:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 753us (924us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788360941.452682:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 187 00000100:00100000:1.0:1788360941.456425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.456496:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130415232 00000100:00100000:3.0:1788360941.456505:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130415232 00000100:00100000:3.0:1788360941.456560:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:3.0:1788360941.456569:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:11483:x1875232130415232:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788360941.456648:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610ef1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.456666:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.456678:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.456705:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610ef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.456712:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.456719:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457027:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457037:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457044:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788360941.457145:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457158:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457164:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610ef1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457171:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457177:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.457181:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457194:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457207:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788360941.457210:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360941.457215:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610ef1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457221:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d6610ef1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457232:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457238:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457244:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457249:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.457252:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457257:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457264:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8a83c0b900) 00010000:00010000:3.0:1788360941.457267:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360941.457269:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610ef8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457284:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610ef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457299:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457304:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457310:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457315:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.457318:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457324:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457332:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:3.0:1788360941.457334:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360941.457336:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.457342:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610eff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.457427:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:11483:x1875232130415232:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 857us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360941.457436:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:1.0:1788360941.525870:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.529917:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130415488 00000100:00100000:2.0:1788360941.529931:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130415488 00000100:00100000:2.0:1788360941.530004:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:2.0:1788360941.530014:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+24:11486:x1875232130415488:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360941.530035:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360941.530057:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6610f06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4bb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530152:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6610f0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530171:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6610f0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530184:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6610f0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530218:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530226:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530233:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530549:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530559:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530567:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360941.530576:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788360941.530666:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6610f0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530675:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6610f0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530681:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6610f0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530688:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360941.530692:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6610f0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530708:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6610f0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530720:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360941.530723:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360941.530728:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6610f0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530735:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6610f0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530748:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530754:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530760:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530778:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360941.530781:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530787:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530793:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8aa8ee1000) 00010000:00010000:2.0:1788360941.530796:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360941.530798:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530814:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530856:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6610f06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4bb expref: 27 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530869:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4bb expref: 26 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.530877:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:2.0:1788360941.530879:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360941.530882:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45000, rc 0) 00000100:00100000:2.0:1788360941.530953:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:11486:x1875232130415488:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 940us (5092us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788360941.530961:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:1.0:1788360941.536484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.536584:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130415616 00000100:00100000:3.0:1788360941.536596:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130415616 00000100:00100000:3.0:1788360941.536661:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00100000:3.0:1788360941.536672:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:11486:x1875232130415616:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:3.0:1788360941.536741:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.536759:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.536782:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.536810:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.536817:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.536824:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.536830:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.536835:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.536841:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.536853:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788360941.536856:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788360941.536860:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.536880:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.536958:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:11486:x1875232130415616:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 287us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360941.536966:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00100000:1.0:1788360941.541293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.541400:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130415872 00000100:00100000:3.0:1788360941.541411:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130415872 00000100:00100000:3.0:1788360941.541469:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:3.0:1788360941.541480:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:11486:x1875232130415872:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788360941.541735:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:11486:x1875232130415872:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 257us (450us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788360941.541744:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:1.0:1788360941.581835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.581925:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130416128 00000100:00100000:2.0:1788360941.581935:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130416128 00000100:00100000:2.0:1788360941.581990:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 191 00000100:00100000:2.0:1788360941.582000:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:11020:x1875232130416128:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788360941.582023:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360941.582055:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6610f30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4c2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.582188:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.582207:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4bb expref: 28 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.582228:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.582261:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4bb expref: 28 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.582275:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4bb expref: 28 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.582299:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83f93100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144035712:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360941.582389:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360941.587067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.587174:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130416256 00000100:00100000:3.0:1788360941.587185:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130416256 00010000:00010000:3.0:1788360941.587225:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4bb expref: 29 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.587287:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1788360941.587298:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985091f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:2349:x1875232130416256:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360941.587313:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360941.587320:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4bb expref: 29 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.587334:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4bb expref: 29 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.587378:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788360941.587384:0:7487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.587392:0:7487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.587399:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.587416:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360941.587473:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985091f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:2349:x1875232130416256:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 177us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360941.587480:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00010000:00010000:2.0:1788360941.588629:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6610f1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4bb expref: 28 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.588652:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83f93100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144035712:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360941.588672:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.588682:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.588687:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360941.588704:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788360941.588958:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6610f30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c2 expref: 29 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.588992:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c2 expref: 28 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.589002:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:2.0:1788360941.589005:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788360941.589008:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44800, rc 0) 00000100:00100000:2.0:1788360941.589068:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:11020:x1875232130416128:12345-192.168.203.60@tcp:101:bash.0 Request processed in 7070us (7241us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788360941.589077:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 191 00000100:00100000:1.0:1788360941.591531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.591619:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130416512 00000100:00100000:3.0:1788360941.591628:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130416512 00000100:00100000:3.0:1788360941.591720:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 192 00000100:00100000:3.0:1788360941.591730:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:11020:x1875232130416512:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:3.0:1788360941.591970:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.591988:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.591999:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788360941.592062:0:6736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788360941.592115:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002826ae05 reply state 00000000a3bcb6c0 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.592138:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788360941.592184:0:6736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788360941.592269:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:11020:x1875232130416512:12345-192.168.203.60@tcp:36:bash.0 Request processed in 540us (745us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788360941.592276:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 192 00000020:00080000:3.0:1788360941.592293:0:6736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788360941.596391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1788360941.596645:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.596736:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130416640 00000100:00100000:3.0:1788360941.596746:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130416640 00010000:00010000:0.0:1788360941.596867:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.596878:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.596884:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360941.596889:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.596897:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.596912:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788360941.596915:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360941.596918:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.596925:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.596952:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:3.0:1788360941.596965:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:11020:x1875232130416640:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788360941.596990:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360941.597006:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610f4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4c9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.597192:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610f4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c9 expref: 32 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.597207:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610f4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c9 expref: 32 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.597224:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788360941.597226:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788360941.597229:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f400, rc 0) 00000100:00100000:3.0:1788360941.597395:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:11020:x1875232130416640:12345-192.168.203.60@tcp:101:bash.0 Request processed in 432us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360941.597403:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:1.0:1788360941.601450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.601557:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130416768 00000100:00100000:3.0:1788360941.601567:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130416768 00000100:00100000:3.0:1788360941.601625:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:3.0:1788360941.601635:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:11020:x1875232130416768:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788360941.601653:0:6594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360941.601673:0:6594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d6610f53 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4d0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788360941.601699:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9838ec, atime: 0x6a9838eb, ctime: 0x6a9838ec, blocks: 0xb 00010000:00010000:3.0:1788360941.601720:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1788360941.601725:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788360941.601733:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d6610f53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d0 expref: 8 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.601749:0:6594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d6610f53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d0 expref: 8 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.601769:0:6594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:3.0:1788360941.601875:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:11020:x1875232130416768:12345-192.168.203.60@tcp:101:bash.0 Request processed in 240us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360941.601882:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:1.0:1788360941.609340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360941.609421:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130416896 00000100:00100000:0.0:1788360941.609433:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130416896 00002000:00010000:0.0:1788360941.609479:0:6600:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788360941.609485:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8985090000 with x1875232130416896 ext(0->18446744073709551615) 00002000:00010000:0.0:1788360941.609499:0:6600:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8985090000. 00000100:00100000:0.0:1788360941.609539:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788360941.609564:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2351:x1875232130416896:12345-192.168.203.60@tcp:10:bash.0 00002000:00010000:0.0:1788360941.609848:0:6600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788360941.609852:0:6600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788360940 -> 1788360942 00002000:00010000:0.0:1788360941.609854:0:6600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788360939 -> 1788360939 00002000:00010000:0.0:1788360941.609857:0:6600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788360940 -> 1788360942 00002000:00010000:0.0:1788360941.609859:0:6600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788360941.609922:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2351:x1875232130416896:12345-192.168.203.60@tcp:10:bash.0 Request processed in 360us (592us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788360941.609930:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00002000:00010000:0.0:1788360941.609935:0:6600:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788360941.609937:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8985090000 with x1875232130416896 ext(0->18446744073709551615) 00002000:00010000:0.0:1788360941.609942:0:6600:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8985090000. 00000100:00100000:1.0:1788360941.693277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360941.693383:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130417024 00000100:00100000:0.0:1788360941.693394:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130417024 00000100:00100000:0.0:1788360941.693458:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 194 00000100:00100000:0.0:1788360941.693468:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:11500:x1875232130417024:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1788360941.693541:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610f5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.693559:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610f5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.693572:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610f5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.693587:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.693611:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.693618:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.693927:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.693937:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.693945:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788360941.693979:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.693990:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610f5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.693997:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610f5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694004:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694009:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360941.694013:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694021:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610f5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694038:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:0.0:1788360941.694041:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360941.694045:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610f5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694051:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d6610f5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694063:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694079:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610f61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694129:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694135:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360941.694138:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694144:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694150:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8a983bf000) 00010000:00010000:0.0:1788360941.694153:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360941.694156:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610f61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694162:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d6610f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694185:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694192:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694198:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694202:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360941.694205:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694211:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694217:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788360941.694219:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360941.694222:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.694227:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360941.694305:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:11500:x1875232130417024:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 837us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360941.694312:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 194 00000100:00100000:1.0:1788360941.744332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.744421:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130417280 00000100:00100000:3.0:1788360941.744432:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130417280 00000100:00100000:3.0:1788360941.744492:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:3.0:1788360941.744502:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+32:11503:x1875232130417280:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360941.744522:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360941.744549:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610f6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4d7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.744625:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610f76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.744641:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610f76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.744653:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610f76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.744667:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.744675:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.744681:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745032:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a600/0xf6a94c97d6610f84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745042:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a600/0xf6a94c97d6610f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745050:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a600/0xf6a94c97d6610f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360941.745060:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788360941.745317:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610f76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745334:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610f76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745340:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610f76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745346:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.745349:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610f76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745356:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610f76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745367:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788360941.745370:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360941.745374:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610f76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745380:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6610f76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745392:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745399:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745405:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745410:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.745419:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745425:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745433:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8a83c0b600) 00010000:00010000:3.0:1788360941.745436:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360941.745439:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745444:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6610f7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745483:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6610f6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d7 expref: 35 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745496:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a600/0xf6a94c97d6610f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d7 expref: 34 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.745502:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788360941.745504:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788360941.745506:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586a600, rc 0) 00000100:00100000:3.0:1788360941.745610:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:11503:x1875232130417280:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1109us (1288us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788360941.745619:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:2.0:1788360941.750557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360941.752052:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130417408 00000100:00100000:0.0:1788360941.752252:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130417408 00000100:00100000:0.0:1788360941.752368:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 196 00000100:00100000:0.0:1788360941.752396:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:11503:x1875232130417408:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:0.0:1788360941.752470:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.752489:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c2 expref: 34 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.752499:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.752534:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c2 expref: 34 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.752548:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c2 expref: 34 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360941.752563:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987c4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144035840:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360941.752659:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab240 going to sleep for 11 seconds 00000100:00100000:1.0:1788360941.758494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.758582:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130417664 00000100:00100000:3.0:1788360941.758592:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130417664 00000100:00100000:3.0:1788360941.758656:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:3.0:1788360941.758667:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:5559:x1875232130417664:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788360941.759056:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:5559:x1875232130417664:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 388us (569us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788360941.759064:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:0.0:1788360941.760483:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987c4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144035840:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360941.760511:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360941.761537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.761663:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130417792 00000100:00100000:2.0:1788360941.761672:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130417792 00010000:00010000:2.0:1788360941.761707:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c2 expref: 36 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.761746:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:2.0:1788360941.761756:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:2349:x1875232130417792:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360941.761782:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360941.761789:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c2 expref: 36 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.761802:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c2 expref: 36 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.761824:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610f37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c2 expref: 36 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.761970:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:2.0:1788360941.761975:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.761985:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.761993:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.762022:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360941.762247:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:2349:x1875232130417792:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 491us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360941.762255:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00010000:00010000:0.0:1788360941.762966:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.762976:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.763016:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.763221:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.763228:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.763234:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360941.763239:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.763248:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.763417:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788360941.763421:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788360941.763426:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.763433:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d6610f92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360941.763546:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:11503:x1875232130417408:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 11150us (12995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360941.763556:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 196 00000100:00100000:1.0:1788360941.765816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.765995:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130418048 00000100:00100000:2.0:1788360941.766005:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130418048 00000100:00100000:2.0:1788360941.766590:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:2.0:1788360941.766602:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+34:11503:x1875232130418048:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788360941.766897:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:11503:x1875232130418048:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 233us (1024us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788360941.766907:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:2.0:1788360941.832013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.833144:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130418304 00000100:00100000:3.0:1788360941.833157:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130418304 00000100:00100000:3.0:1788360941.833223:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:3.0:1788360941.833234:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+35:11514:x1875232130418304:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1788360941.833259:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360941.833281:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610f99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4de expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.833354:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fa0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.833368:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.833380:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.833393:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.833400:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.833417:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.833748:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d6610fae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.833779:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d6610fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.833786:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d6610fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360941.834183:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788360941.834282:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fa0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834290:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fa0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834297:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834303:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ba00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.834308:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834315:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834328:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788360941.834331:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360941.834335:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fa0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834342:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fa0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834354:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834367:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834372:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834378:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.834381:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834387:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834395:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8a83c0b600) 00010000:00010000:3.0:1788360941.834398:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360941.834401:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fa7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834560:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834609:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610f99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4de expref: 38 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834624:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d6610fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4de expref: 37 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.834631:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788360941.834634:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788360941.834642:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586a400, rc 0) 00000100:00100000:3.0:1788360941.834885:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:11514:x1875232130418304:12345-192.168.203.60@tcp:101:cat.0 Request processed in 1651us (2880us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788360941.834894:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:1.0:1788360941.840501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.840691:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130418560 00000100:00100000:3.0:1788360941.840701:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130418560 00000100:00100000:3.0:1788360941.840775:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:3.0:1788360941.840785:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:11514:x1875232130418560:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:3.0:1788360941.841066:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+38:11514:x1875232130418560:12345-192.168.203.60@tcp:35:cat.0 Request processed in 282us (577us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788360941.841073:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:1.0:1788360941.862833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.863352:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130418816 00000100:00100000:3.0:1788360941.863364:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130418816 00000100:00100000:3.0:1788360941.863429:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 198 00000100:00100000:3.0:1788360941.863438:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+38:11515:x1875232130418816:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:3.0:1788360941.863492:0:6736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788360941.863521:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d6610fae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4de expref: 38 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.863543:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a600/0xf6a94c97d6610f84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d7 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.863681:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6610f4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4c9 expref: 36 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.863691:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788360941.863702:0:6736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360941.863747:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610fbc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.863770:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610fbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.863781:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610fbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.864199:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.864210:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.864219:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.864932:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fca lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.864944:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.864953:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788360941.866071:0:6736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:3.0:1788360941.866188:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866201:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866222:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866231:0:6736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866237:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866243:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866362:0:6736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788360941.866384:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866392:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866398:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866406:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ba00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.866419:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866427:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866439:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:3.0:1788360941.866442:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788360941.866453:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fca lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866459:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d6610fca lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866478:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610fbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866485:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610fbc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866491:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610fbc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866497:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ae00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360941.866500:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610fbc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866506:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610fbc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866515:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788360941.866517:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360941.866520:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610fbc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.866526:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6610fbc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788360941.866535:0:6736:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a87bd2b6 reply state 00000000f1c003e7 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360941.866565:0:6736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788360941.866663:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+37:11515:x1875232130418816:12345-192.168.203.60@tcp:36:rm.0 Request processed in 3223us (3838us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788360941.866671:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 198 00010000:00010000:2.0:1788360941.867998:0:11019:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360941.868010:0:11019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.868022:0:11019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586be00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788360941.868040:0:11019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.868049:0:11019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.868063:0:11019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:2.0:1788360941.868066:0:11019:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788360941.868070:0:11019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.868076:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d6610fd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.868202:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360941.868204:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360941.868206:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360941.869076:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.869113:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.869120:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.869136:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360941.869140:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.869147:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.869160:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8a83c0b600) 00010000:00010000:0.0:1788360941.869163:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360941.869167:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.869173:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ac00/0xf6a94c97d6610fc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360941.910838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.910943:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130419072 00000100:00100000:2.0:1788360941.910955:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130419072 00000100:00100000:2.0:1788360941.911025:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:2.0:1788360941.911035:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+36:11521:x1875232130419072:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788360941.911063:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360941.911140:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610fd8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.911274:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610fdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.911290:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610fdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.911301:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610fdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.911340:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.911348:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.911356:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788360941.912754:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788360941.912939:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.912954:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.912965:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.913010:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610fdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.913018:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610fdf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.913026:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610fdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.913033:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360941.913037:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610fdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.913059:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610fdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.913072:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360941.913075:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360941.913079:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610fdf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.913126:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6610fdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360941.913142:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008fd5403d reply state 0000000030c4bb8d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.913152:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788360941.913189:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6610fd8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4e5 expref: 39 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.913203:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4e5 expref: 38 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.913210:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8aa8ee1400) 00010000:00010000:2.0:1788360941.913212:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360941.913214:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45400, rc 0) 00000100:00100000:2.0:1788360941.913297:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+39:11521:x1875232130419072:12345-192.168.203.60@tcp:101:bash.0 Request processed in 2263us (2469us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788360941.913307:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 199 00010000:00010000:0.0:1788360941.916905:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.916923:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.916931:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.916938:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360941.916944:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.916952:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.916990:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8aa8ee1000) 00010000:00010000:0.0:1788360941.916993:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360941.916998:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360941.917005:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6610fe6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360941.921024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.921559:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130419200 00000100:00100000:3.0:1788360941.921569:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130419200 00000100:00100000:3.0:1788360941.921702:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:3.0:1788360941.921712:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2351:x1875232130419200:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788360941.921730:0:9606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360941.921750:0:9606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a86df5f/0xf6a94c97d6610ffb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4ec expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788360941.921786:0:9606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788360941.921806:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1788360941.921811:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788360941.921820:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a86df5f/0xf6a94c97d6610ffb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ec expref: 6 pid: 9606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.921839:0:9606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a86df5f/0xf6a94c97d6610ffb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ec expref: 6 pid: 9606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360941.921854:0:9606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586ae00, rc 0) 00000100:00100000:3.0:1788360941.921921:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2351:x1875232130419200:12345-192.168.203.60@tcp:101:bash.0 Request processed in 210us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360941.921928:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00080000:2.0:1788360941.923896:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788360941.925254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.925358:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130419328 00000100:00100000:2.0:1788360941.925382:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130419328 00000100:00100000:2.0:1788360941.925447:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:2.0:1788360941.925459:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:11521:x1875232130419328:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788360941.925481:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360941.925500:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4f3 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.925530:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a86df5f/0xf6a94c97d6610ffb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ec expref: 7 pid: 9606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.925538:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360941.925542:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360941.925546:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.925577:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a86df5f/0xf6a94c97d6610ffb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ec expref: 7 pid: 9606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.925593:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a86df5f/0xf6a94c97d6610ffb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ec expref: 7 pid: 9606 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.925606:0:6593:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6593:1875232144035968:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360941.925689:0:6593:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360941.928608:0:6593:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6593:1875232144035968:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360941.928647:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.928687:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44800, rc 0) 00000100:00100000:2.0:1788360941.928748:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:11521:x1875232130419328:12345-192.168.203.60@tcp:101:bash.0 Request processed in 3292us (3501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360941.928769:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:1.0:1788360941.930594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360941.930711:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130419456 00000100:00100000:2.0:1788360941.930720:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130419456 00010000:00010000:2.0:1788360941.930751:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a86df5f/0xf6a94c97d6610ffb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ec expref: 7 pid: 9606 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.930797:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:2.0:1788360941.930805:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6cea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130419456:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360941.930819:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360941.930840:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a86df5f/0xf6a94c97d6610ffb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ec expref: 7 pid: 9606 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.930853:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a86df5f/0xf6a94c97d6610ffb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ec expref: 7 pid: 9606 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.930874:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a86df5f/0xf6a94c97d6610ffb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4ec expref: 7 pid: 9606 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.930889:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360941.930893:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360941.930900:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.930921:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360941.930951:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360941.930964:0:5782:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5782:1875232144036096:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788360941.932468:0:5782:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788360941.933208:0:5782:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5782:1875232144036096:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788360941.933234:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360941.933470:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6cea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130419456:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 2663us (2881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360941.933480:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:1.0:1788360941.934344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360941.934546:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130419712 00000100:00100000:3.0:1788360941.934555:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130419712 00000100:00100000:3.0:1788360941.934610:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:3.0:1788360941.934620:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+38:11521:x1875232130419712:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:3.0:1788360941.935004:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+39:11521:x1875232130419712:12345-192.168.203.60@tcp:35:bash.0 Request processed in 385us (665us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788360941.935013:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1788360942.086271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.086386:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130419840 00000100:00100000:2.0:1788360942.086399:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130419840 00000100:00100000:2.0:1788360942.086461:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:2.0:1788360942.086471:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+39:11537:x1875232130419840:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360942.086501:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360942.086524:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e4fa expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.086599:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6611010 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.086615:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6611010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.086644:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6611010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360942.086707:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1788360942.086712:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360942.086736:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6611010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.086773:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4fa expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.086793:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6611010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4fa expref: 40 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.086802:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360942.086805:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788360942.086808:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45a00, rc 0) 00000100:00100000:2.0:1788360942.086872:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+40:11537:x1875232130419840:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 402us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360942.086878:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:1.0:1788360942.091204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.091303:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130420096 00000100:00100000:2.0:1788360942.091313:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130420096 00000100:00100000:2.0:1788360942.091372:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:2.0:1788360942.091382:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+40:11537:x1875232130420096:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360942.091401:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360942.091420:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611017 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e501 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.091541:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d661101e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.091557:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d661101e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.091569:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d661101e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360942.091583:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788360942.091726:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611017 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e501 expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.091747:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d661101e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e501 expref: 42 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.091766:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8aa8ee1400) 00010000:00010000:2.0:1788360942.091770:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360942.091774:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45000, rc 0) 00000100:00100000:2.0:1788360942.091837:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+42:11537:x1875232130420096:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 457us (645us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788360942.091845:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:1.0:1788360942.099779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360942.099836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360942.099892:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130420480 00000100:00100000:3.0:1788360942.099904:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130420480 00000100:00100000:3.0:1788360942.099972:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788360942.099982:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+42:2351:x1875232130420480:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360942.099999:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360942.100027:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d661101e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e501 expref: 42 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.100049:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8aa8ee1400) 00010000:00010000:3.0:1788360942.100054:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360942.100147:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:2351:x1875232130420480:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 165us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360942.100155:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788360942.101068:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130420352 00000100:00100000:2.0:1788360942.101076:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130420352 00000100:00100000:2.0:1788360942.101144:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 202 00000100:00100000:2.0:1788360942.101153:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+41:11537:x1875232130420352:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360942.101179:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360942.101210:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d661102c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e508 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.101972:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611033 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.101990:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.102003:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360942.102016:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788360942.102191:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d661102c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e508 expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.102209:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e508 expref: 43 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.102217:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8aa8ee1400) 00010000:00010000:2.0:1788360942.102232:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788360942.102235:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44a00, rc 0) 00000100:00100000:2.0:1788360942.102584:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+43:11537:x1875232130420352:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1430us (2810us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788360942.102594:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 202 00000100:00100000:1.0:1788360942.109906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360942.109992:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130420608 00000100:00100000:3.0:1788360942.110002:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130420608 00000100:00100000:3.0:1788360942.110181:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:3.0:1788360942.110193:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+6:2350:x1875232130420608:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:3.0:1788360942.110243:0:9606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.110286:0:9606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.110294:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788360942.110298:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788360942.110302:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.110345:0:9606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.110360:0:9606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 6 pid: 6593 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360942.110376:0:9606:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89265500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9606:1875232144036224:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788360942.110542:0:9606:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788360942.112978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.113058:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130420736 00000100:00100000:2.0:1788360942.113069:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130420736 00002000:00100000:2.0:1788360942.113163:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a8ab6ce9f80 x1875232130420736/t0(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:3/0 lens 504/0 e 0 to 0 dl 1788360953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788360942.113174:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6ce9f80 with x1875232130420736 ext(0->8) 00010000:00010000:2.0:1788360942.113199:0:6599:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 7 pid: 6593 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.113217:0:6599:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 7 pid: 6593 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788360942.113225:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8ab6ce9f80 00000100:00100000:2.0:1788360942.113264:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:2.0:1788360942.113274:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130420736:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:2.0:1788360942.113771:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2350:x1875232130420736:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 487us (792us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788360942.113780:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00002000:00100000:2.0:1788360942.113787:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a8ab6ce9f80 x1875232130420736/t4294967308(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:3/0 lens 504/448 e 0 to 0 dl 1788360953 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788360942.113797:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6ce9f80 with x1875232130420736 ext(0->8) 00010000:00010000:2.0:1788360942.113802:0:6599:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 9 pid: 6593 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.113814:0:6599:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 9 pid: 6593 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788360942.113821:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8ab6ce9f80 00000100:00100000:3.0:1788360942.114445:0:9606:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89265500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9606:1875232144036224:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788360942.114468:0:9606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360942.116631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.116720:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130420864 00000100:00100000:2.0:1788360942.116730:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130420864 00010000:00010000:2.0:1788360942.116779:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 9 pid: 6593 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360942.116846:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:2.0:1788360942.116856:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2350:x1875232130420864:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360942.116873:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788360942.116894:0:5783:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788360942.116897:0:5783:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788360942 00002000:00010000:2.0:1788360942.116899:0:5783:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788360942 00002000:00010000:2.0:1788360942.116902:0:5783:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788360942 00010000:00010000:2.0:1788360942.116907:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 9 pid: 6593 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.116920:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 9 pid: 6593 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.116944:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6b492c/0xf6a94c97d6611002 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4f3 expref: 9 pid: 6593 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.116962:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788360942.116966:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788360942.116972:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.116983:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.117020:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360942.117127:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2350:x1875232130420864:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 271us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360942.117135:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00010000:00010000:1.0:1788360942.117201:0:9606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.117211:0:9606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.117235:0:9606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.117256:0:9606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.117264:0:9606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.117272:0:9606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ba00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788360942.117277:0:9606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.117287:0:9606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.117300:0:9606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.117308:0:9606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5f825e1/0xf6a94c97d6611041 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360942.117355:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2350:x1875232130420608:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 7165us (7460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360942.117362:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:1.0:1788360942.120314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.120463:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130421120 00000100:00100000:2.0:1788360942.120474:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130421120 00000100:00100000:2.0:1788360942.120535:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:2.0:1788360942.120545:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ea8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+43:11537:x1875232130421120:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:2.0:1788360942.120616:0:5801:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e508 expref: 43 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788360942.120882:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788360942.120919:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788360942.121465:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788360942.121519:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.121535:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4e5 expref: 47 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.121544:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.121579:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4e5 expref: 47 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.121594:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4e5 expref: 47 pid: 5798 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360942.121608:0:5801:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1875232144036352:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360942.121702:0:5801:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788360942.125064:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360942.125257:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130421248 00000100:00100000:1.0:1788360942.125282:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130421248 00010000:00010000:1.0:1788360942.125333:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4e5 expref: 48 pid: 5798 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360942.125366:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:1.0:1788360942.125375:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+48:2349:x1875232130421248:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360942.125394:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360942.125402:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4e5 expref: 48 pid: 5798 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.125415:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4e5 expref: 48 pid: 5798 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.125441:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8aa8ee1400) 00010000:00010000:1.0:1788360942.125447:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.125460:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.125469:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.125490:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360942.125539:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+48:2349:x1875232130421248:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 164us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360942.125547:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00010000:00010000:2.0:1788360942.126261:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6610fed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4e5 expref: 47 pid: 5798 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360942.126298:0:5801:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1875232144036352:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360942.126319:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.126328:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.126334:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788360942.126472:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788360942.126677:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788360942.126793:0:5801:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7799f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144036480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788360942.126848:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360942.126877:0:5801:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49900 going to sleep for 11 seconds 00000100:00100000:3.0:1788360942.128230:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144036480 00000100:00100000:3.0:1788360942.128244:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144036480 00000100:00100000:3.0:1788360942.128525:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788360942.128536:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5801:x1875232144036480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788360942.128690:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5801:x1875232144036480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 157us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360942.128697:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788360942.128840:0:5801:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7799f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144036480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788360942.129620:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788360942.129703:0:5801:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987c48000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144036608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788360942.129751:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360942.129783:0:5801:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788360942.129857:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144036608 00000100:00100000:3.0:1788360942.129864:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144036608 00000100:00100000:3.0:1788360942.129904:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788360942.129912:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5801:x1875232144036608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788360942.130077:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5801:x1875232144036608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 166us (325us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788360942.130112:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788360942.130357:0:5801:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987c48000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1875232144036608:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788360942.130417:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788360942.130464:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.130473:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.130480:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.130486:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360942.130491:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.130512:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.130531:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8aa8ee1400) 00010000:00010000:0.0:1788360942.130534:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788360942.130539:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.130546:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611048 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788360942.130716:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788360942.130829:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788360942.130839:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332145752907ns, next at 333145750903ns, rc = 0 00000001:00080000:0.0:1788360942.130845:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788360942.130876:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8aa8ee1400) 00010000:00010000:0.0:1788360942.130879:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788360942.130886:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611033 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e508 expref: 51 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360942.131070:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ea8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+50:11537:x1875232130421120:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 10526us (10766us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788360942.131078:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000020:00080000:0.0:1788360942.131083:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1788360942.131239:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788360942.135830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360942.135908:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130421376 00000100:00100000:3.0:1788360942.135918:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130421376 00000100:00100000:3.0:1788360942.135979:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:3.0:1788360942.135989:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+50:11537:x1875232130421376:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788360942.136015:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360942.136047:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a600/0xf6a94c97d661104f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e50f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.136142:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a600/0xf6a94c97d661104f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e50f expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.136157:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a600/0xf6a94c97d661104f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e50f expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.136176:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788360942.136180:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788360942.136196:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586a600, rc 0) 00000100:00100000:3.0:1788360942.136248:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+51:11537:x1875232130421376:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 261us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360942.136254:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:1.0:1788360942.139489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360942.139568:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130421632 00000100:00100000:3.0:1788360942.139579:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130421632 00000100:00100000:3.0:1788360942.139633:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:3.0:1788360942.139641:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+51:11537:x1875232130421632:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788360942.139898:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:11537:x1875232130421632:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 257us (417us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788360942.139906:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:1.0:1788360942.209176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.209283:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130421760 00000100:00100000:2.0:1788360942.209295:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130421760 00000100:00100000:2.0:1788360942.209360:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:2.0:1788360942.209371:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:11547:x1875232130421760:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788360942.209448:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611056 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209468:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611056 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209497:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611056 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209514:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661105d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209521:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661105d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209527:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661105d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209629:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209637:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209644:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788360942.209682:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209693:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611056 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209699:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611056 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209706:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611056 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209720:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360942.209725:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611056 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209733:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611056 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209745:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360942.209748:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360942.209752:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611056 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209769:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611056 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209784:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661105d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209790:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661105d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209795:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661105d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209801:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360942.209803:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661105d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209809:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661105d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209828:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8aa8ee1600) 00010000:00010000:2.0:1788360942.209831:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360942.209833:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661105d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209839:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661105d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209855:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209861:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209866:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209870:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360942.209873:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209879:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209886:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788360942.209888:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360942.209891:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.209896:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611064 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360942.209984:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:11547:x1875232130421760:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 614us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360942.209993:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:1.0:1788360942.215456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360942.215518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360942.215565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360942.215678:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130422144 00000100:00100000:3.0:1788360942.215689:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130422144 00000100:00100000:3.0:1788360942.215792:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:3.0:1788360942.215803:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2352:x1875232130422144:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360942.215889:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2352:x1875232130422144:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360942.215897:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00080000:1.0:1788360942.215982:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788360942.216530:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130421888 00000100:00100000:2.0:1788360942.216536:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130421888 00000100:00100000:2.0:1788360942.216578:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 282 00000100:00100000:2.0:1788360942.216585:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2352:x1875232130421888:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360942.216600:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130422016 00000100:00100000:0.0:1788360942.216605:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130422016 00000100:00100000:2.0:1788360942.216627:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2352:x1875232130421888:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 42us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360942.216633:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 282 00000100:00100000:0.0:1788360942.216654:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:0.0:1788360942.216661:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2352:x1875232130422016:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360942.216698:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2352:x1875232130422016:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360942.216706:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00080000:3.0:1788360942.216726:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788360942.248685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.248871:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130422400 00000100:00100000:2.0:1788360942.248883:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130422400 00000100:00100000:2.0:1788360942.248960:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:2.0:1788360942.248975:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+52:11550:x1875232130422400:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360942.249028:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360942.249064:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d661106b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e516 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249238:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611072 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249267:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611072 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249280:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611072 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249340:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249359:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249368:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249540:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249549:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249557:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360942.249567:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788360942.249679:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611072 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249687:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611072 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249693:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611072 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249699:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360942.249704:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611072 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249726:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611072 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249739:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360942.249741:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360942.249746:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249750:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249772:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249778:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611079 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249782:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249785:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360942.249787:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249790:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611079 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249794:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8aa8ee1600) 00010000:00010000:2.0:1788360942.249796:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360942.249797:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611079 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249808:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6611079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249840:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d661106b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e516 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249849:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e516 expref: 54 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.249854:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788360942.249855:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360942.249857:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44a00, rc 0) 00000100:00100000:2.0:1788360942.249948:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:11550:x1875232130422400:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 976us (1272us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788360942.249953:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:1.0:1788360942.254160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360942.254470:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130422528 00000100:00100000:3.0:1788360942.254481:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130422528 00000100:00100000:3.0:1788360942.254576:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 206 00000100:00100000:3.0:1788360942.254588:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:11550:x1875232130422528:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:3.0:1788360942.254699:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661108e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.254720:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661108e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.254752:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661108e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.254812:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661108e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.254820:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661108e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.254826:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661108e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.254833:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586a400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360942.254853:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661108e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.254860:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661108e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.254873:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788360942.254876:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788360942.254881:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661108e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.254887:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661108e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360942.254962:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:11550:x1875232130422528:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 376us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360942.254970:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 206 00000100:00100000:1.0:1788360942.257266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360942.257401:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130422784 00000100:00100000:3.0:1788360942.257424:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130422784 00000100:00100000:3.0:1788360942.257479:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:3.0:1788360942.257488:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+54:11550:x1875232130422784:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788360942.257720:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:11550:x1875232130422784:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 233us (463us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788360942.257728:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00010000:00010000:1.0:1788360942.304644:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360942.342715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360942.342892:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130423040 00000100:00100000:3.0:1788360942.342903:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130423040 00000100:00100000:3.0:1788360942.342967:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:3.0:1788360942.342978:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:11560:x1875232130423040:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788360942.343003:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360942.343006:0:6736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788360942.343035:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d6611010 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4fa expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.343057:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788360942.343063:0:6736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360942.343081:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d6611095 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e51d expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.343313:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.343329:0:6736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e516 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.343338:0:6736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.343417:0:6736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e516 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.343430:0:6736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e516 expref: 55 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360942.343443:0:6736:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89265500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6736:1875232144036736:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788360942.343539:0:6736:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788360942.349864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360942.350383:0:6736:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89265500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6736:1875232144036736:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360942.350417:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130423168 00010000:00010000:3.0:1788360942.350418:0:6736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360942.350425:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130423168 00010000:00010000:0.0:1788360942.350466:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e516 expref: 56 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360942.350511:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:0.0:1788360942.350522:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+56:2350:x1875232130423168:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360942.350537:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360942.350544:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e516 expref: 56 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.350556:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e516 expref: 56 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.350579:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e516 expref: 56 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.350595:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:0.0:1788360942.350600:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.350609:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.350616:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.350662:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360942.350721:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:2350:x1875232130423168:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 201us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360942.350729:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00010000:00010000:3.0:1788360942.350816:0:6736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.350825:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360942.350852:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788360942.351451:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d6611095 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e51d expref: 56 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.351472:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e51d expref: 55 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.351480:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788360942.351484:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788360942.351499:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586ba00, rc 0) 00000100:00100000:3.0:1788360942.351548:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:11560:x1875232130423040:12345-192.168.203.60@tcp:101:bash.0 Request processed in 8571us (8842us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788360942.351557:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:1.0:1788360942.356955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360942.361579:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130423424 00000100:00100000:3.0:1788360942.361593:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130423424 00000100:00100000:2.0:1788360942.363264:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:2.0:1788360942.363282:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+55:11560:x1875232130423424:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:2.0:1788360942.363520:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.363536:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.363548:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788360942.363594:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788360942.363629:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006939fb15 reply state 000000007acf13e5 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360942.363638:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788360942.363732:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+58:11560:x1875232130423424:12345-192.168.203.60@tcp:36:bash.0 Request processed in 458us (6787us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788360942.363740:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 208 00000020:00080000:2.0:1788360942.363744:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788360942.365668:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.365686:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.365693:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.365699:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360942.365705:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.365714:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.365733:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:0.0:1788360942.365736:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360942.365741:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.365747:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66110aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360942.366504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.366819:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130423552 00000100:00100000:2.0:1788360942.366830:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130423552 00000100:00100000:2.0:1788360942.366884:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:2.0:1788360942.366894:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:11560:x1875232130423552:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788360942.366921:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360942.366939:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66110b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e524 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.367369:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.367386:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e51d expref: 58 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.367394:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.367429:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e51d expref: 58 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.367442:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e51d expref: 58 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360942.367470:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985091880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144036864:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360942.367668:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935180 going to sleep for 11 seconds 00000100:00100000:3.0:1788360942.377672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360942.377785:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130423680 00000100:00100000:1.0:1788360942.377795:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130423680 00010000:00010000:1.0:1788360942.377845:0:7487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e51d expref: 59 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360942.377946:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1788360942.377965:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:2350:x1875232130423680:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360942.377985:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360942.378000:0:7487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e51d expref: 59 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.378014:0:7487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e51d expref: 59 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.378051:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:1.0:1788360942.378056:0:7487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.378066:0:7487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.378145:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.378163:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360942.378239:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:2350:x1875232130423680:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 284us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360942.378255:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00010000:00010000:2.0:1788360942.378963:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ba00/0xf6a94c97d661109c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e51d expref: 58 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360942.378988:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985091880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144036864:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360942.379022:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.379046:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.379053:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360942.379157:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788360942.379162:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360942.379207:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.379261:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66110b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e524 expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.379279:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e524 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.379288:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788360942.379302:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360942.379306:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44800, rc 0) 00000100:00100000:2.0:1788360942.379356:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:11560:x1875232130423552:12345-192.168.203.60@tcp:101:bash.0 Request processed in 12463us (12856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360942.379364:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:3.0:1788360942.384327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.385512:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130423936 00000100:00100000:2.0:1788360942.385527:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130423936 00000100:00100000:2.0:1788360942.385717:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:2.0:1788360942.385730:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+57:11560:x1875232130423936:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1788360942.386013:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+58:11560:x1875232130423936:12345-192.168.203.60@tcp:35:bash.0 Request processed in 285us (1695us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788360942.386022:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:0.0:1788360942.455605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.455729:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130424064 00000100:00100000:2.0:1788360942.455741:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130424064 00000100:00100000:2.0:1788360942.455811:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 210 00000100:00100000:2.0:1788360942.455821:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+58:11566:x1875232130424064:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360942.455844:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360942.455862:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66110bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e52b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.457034:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d66110c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.457053:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d66110c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.457065:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d66110c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360942.457150:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1788360942.457154:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360942.457173:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d66110c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.457198:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66110bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e52b expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.457217:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d66110c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e52b expref: 59 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.457226:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360942.457229:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788360942.457232:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45000, rc 0) 00000100:00100000:2.0:1788360942.457290:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:11566:x1875232130424064:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1470us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360942.457297:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 210 00000100:00100000:3.0:1788360942.461438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360942.461539:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130424192 00000100:00100000:1.0:1788360942.461549:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130424192 00000100:00100000:1.0:1788360942.461602:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:1.0:1788360942.461613:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:11566:x1875232130424192:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788360942.461643:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360942.461663:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e532 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461721:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66110d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461735:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66110d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461747:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66110d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461772:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66110db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461780:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66110db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461805:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66110db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461898:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461907:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461914:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360942.461949:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788360942.461953:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360942.461972:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461982:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461990:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66110d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.461996:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66110d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462003:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66110d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462008:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705bc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360942.462013:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66110d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462043:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66110d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462055:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:1.0:1788360942.462058:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360942.462062:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66110d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462067:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d66110d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462080:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66110db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462291:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66110db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462298:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66110db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462304:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788360942.462307:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66110db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462314:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66110db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462322:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8abc8ce000) 00010000:00010000:1.0:1788360942.462325:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360942.462328:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66110db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462344:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d66110db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462381:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e532 expref: 61 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462395:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e532 expref: 60 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.462402:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:1.0:1788360942.462404:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360942.462406:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a200, rc 0) 00000100:00100000:1.0:1788360942.462512:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11566:x1875232130424192:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 899us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360942.462521:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:1.0:1788360942.466386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360942.466429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360942.466547:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130424576 00000100:00100000:0.0:1788360942.466571:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130424576 00000100:00100000:0.0:1788360942.466638:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 212 00000100:00100000:0.0:1788360942.466650:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11566:x1875232130424576:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360942.466671:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360942.466692:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d66110e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e539 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.466806:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.466821:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e524 expref: 61 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.466829:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e532 expref: 61 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.466837:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.466868:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e532 expref: 61 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.466882:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e532 expref: 61 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360942.466895:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987c49880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144036992:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360942.466995:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e524 expref: 61 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.467017:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e524 expref: 61 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360942.467032:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987c48380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144037120:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360942.467059:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788360942.467722:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130424320 00000100:00100000:3.0:1788360942.467729:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130424320 00010000:00010000:3.0:1788360942.467765:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e532 expref: 62 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360942.467792:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788360942.467800:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+62:2350:x1875232130424320:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360942.467811:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360942.467817:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e532 expref: 62 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.467829:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e532 expref: 62 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.467848:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788360942.467852:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.467860:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360942.467874:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360942.467917:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+62:2350:x1875232130424320:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 117us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360942.467925:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00010000:00010000:0.0:1788360942.470562:0:5799:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.60@tcp) returned -22 from blocking AST (req@00000000258bb52a x1875232144036992) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e532 expref: 61 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.470587:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a200/0xf6a94c97d66110e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e532 expref: 61 pid: 6736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360942.470606:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987c49880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144036992:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788360942.470960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360942.471549:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130424704 00000100:00100000:1.0:1788360942.471558:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130424704 00010000:00010000:1.0:1788360942.471593:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e524 expref: 61 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360942.471791:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987c48380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144037120:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360942.471817:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:0.0:1788360942.471823:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.471831:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.471839:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360942.471879:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:1.0:1788360942.471890:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:2350:x1875232130424704:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360942.471905:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360942.471911:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e524 expref: 61 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.471933:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e524 expref: 61 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.471952:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66110b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e524 expref: 61 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.471965:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:1.0:1788360942.471969:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.471977:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.471984:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.472009:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360942.472058:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:2350:x1875232130424704:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 169us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360942.472065:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00010000:00010000:0.0:1788360942.472124:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.472140:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360942.472162:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788360942.472328:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43a00/0xf6a94c97d66110e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e539 expref: 61 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.472344:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e539 expref: 60 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360942.472351:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:0.0:1788360942.472354:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788360942.472356:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42800, rc 0) 00000100:00100000:0.0:1788360942.472384:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11566:x1875232130424576:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 5737us (5954us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788360942.472391:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 212 00000100:00100000:3.0:1788360942.475290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.475434:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130424960 00000100:00100000:2.0:1788360942.475443:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130424960 00000100:00100000:2.0:1788360942.475503:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788360942.475513:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11566:x1875232130424960:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:2.0:1788360942.475530:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360942.475553:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a600/0xf6a94c97d661104f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e50f expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.475572:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788360942.475590:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360942.475662:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:11566:x1875232130424960:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 150us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360942.475669:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788360942.478744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360942.479238:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130425088 00000100:00100000:1.0:1788360942.479248:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130425088 00000100:00100000:1.0:1788360942.479396:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:1.0:1788360942.479407:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:11566:x1875232130425088:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:1.0:1788360942.479508:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.479527:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360942.479551:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788360942.479741:0:6736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788360942.479846:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:11566:x1875232130425088:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 440us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360942.479854:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:0.0:1788360942.481906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360942.482406:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130425216 00000100:00100000:2.0:1788360942.482416:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130425216 00000100:00100000:2.0:1788360942.482473:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:2.0:1788360942.482483:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+59:11566:x1875232130425216:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788360942.482506:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360942.482531:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611105 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e540 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.482588:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.482597:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611105 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e540 expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.482615:0:5797:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.482746:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611105 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e540 expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.482769:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788360942.482772:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788360942.482776:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611105 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e540 expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360942.482799:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44a00, rc 0) 00000100:00100000:2.0:1788360942.482905:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11566:x1875232130425216:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 423us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360942.482912:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 214 00000040:00080000:2.0:1788360943.328350:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788360943.328360:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788360943.328401:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 4 00000040:00080000:2.0:1788360943.328406:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788360943.328534:0:11534:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985092680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144037248:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788360943.328652:0:11534:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935180 going to sleep for 11 seconds 00010000:00010000:2.0:1788360943.329861:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360943.332203:0:11534:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985092680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144037248:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788360943.335340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.338051:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130425344 00000100:00100000:2.0:1788360943.338066:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130425344 00000100:00100000:2.0:1788360943.338175:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:2.0:1788360943.338186:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11567:x1875232130425344:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788360943.338218:0:5799:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788360943.338330:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11567:x1875232130425344:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 145us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360943.338337:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00080000:3.0:1788360943.338456:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360943.353424:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.353560:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130425472 00000100:00100000:2.0:1788360943.353580:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130425472 00000100:00100000:2.0:1788360943.353651:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:2.0:1788360943.353662:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11567:x1875232130425472:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788360943.353765:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661110c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353783:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661110c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353795:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661110c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353810:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611113 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353818:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611113 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353824:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611113 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353845:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353854:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353860:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360943.353910:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788360943.353914:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788360943.353927:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353938:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661110c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353949:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661110c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353955:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661110c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353962:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360943.353966:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661110c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353974:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661110c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353985:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:2.0:1788360943.353988:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360943.353993:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661110c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.353998:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661110c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354013:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611113 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354019:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611113 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354026:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611113 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354030:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360943.354039:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611113 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354046:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611113 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354054:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9a8aa8ee1600) 00010000:00010000:2.0:1788360943.354056:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360943.354059:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611113 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354064:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6611113 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354080:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354119:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354125:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354131:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360943.354134:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354140:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354148:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788360943.354150:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788360943.354159:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.354165:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d661111a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360943.354245:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11567:x1875232130425472:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 585us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360943.354253:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:0.0:1788360943.356981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.357141:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130425728 00000100:00100000:2.0:1788360943.357152:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130425728 00000100:00100000:2.0:1788360943.357216:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 217 00000100:00100000:2.0:1788360943.357228:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+60:11567:x1875232130425728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788360943.357250:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360943.357269:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611121 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e547 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357378:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357392:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357413:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788360943.357425:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788360943.357529:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357537:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611128 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357556:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357561:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360943.357565:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357572:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357583:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788360943.357586:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788360943.357590:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611128 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357596:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d6611128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357643:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611121 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e547 expref: 62 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357666:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:2.0:1788360943.357668:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788360943.357673:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611121 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e547 expref: 62 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.357685:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45200, rc 0) 00000100:00100000:2.0:1788360943.357758:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:11567:x1875232130425728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 523us (778us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788360943.357775:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 217 00000100:00100000:0.0:1788360943.363871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.364155:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130425856 00000100:00100000:2.0:1788360943.364171:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130425856 00000100:00100000:2.0:1788360943.364235:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:2.0:1788360943.364246:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:11567:x1875232130425856:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788360943.364456:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788360943.364581:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:11567:x1875232130425856:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 335us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360943.364589:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:0.0:1788360943.372004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.372141:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130426112 00000100:00100000:2.0:1788360943.372151:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130426112 00000100:00100000:2.0:1788360943.372214:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:2.0:1788360943.372224:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:11567:x1875232130426112:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788360943.372244:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360943.372247:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788360943.372274:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d66110c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e52b expref: 61 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.372294:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788360943.372299:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788360943.372311:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611136 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e54e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788360943.372715:0:5799:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788360943.373068:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d661113d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.373247:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d661113d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.373258:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d661113d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.373318:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611136 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e54e expref: 63 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.373335:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d661113d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e54e expref: 62 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.373343:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8aa8ee1600) 00010000:00010000:2.0:1788360943.373346:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788360943.373348:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44200, rc 0) 00000100:00100000:2.0:1788360943.373474:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+62:11567:x1875232130426112:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1250us (1476us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788360943.373482:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:0.0:1788360943.378244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360943.378502:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130426368 00000100:00100000:3.0:1788360943.378513:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130426368 00000100:00100000:3.0:1788360943.378604:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00100000:3.0:1788360943.378616:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+62:11567:x1875232130426368:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788360943.378679:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360943.378705:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d661113d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e54e expref: 62 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.378726:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8aa8ee1600) 00010000:00010000:3.0:1788360943.378737:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788360943.378770:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661114b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.378784:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661114b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.378793:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661114b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.378862:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6611152 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x25c1b92c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.378888:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6611152 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x25c1b92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.378896:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6611152 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x25c1b92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.378976:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661114b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.378983:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661114b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.378990:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661114b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.378996:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586a400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360943.379000:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661114b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.379008:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661114b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.379514:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788360943.379520:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360943.379524:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661114b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.379531:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d661114b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.379544:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6611152 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x25c1b92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.379558:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6611152 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x25c1b92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.379564:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6611152 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x25c1b92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.379569:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ae00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360943.379572:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6611152 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x25c1b92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.379578:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6611152 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x25c1b92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.379588:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x25c1b92c (ffff9a8a83c0b400) 00010000:00010000:3.0:1788360943.379590:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360943.379593:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6611152 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x25c1b92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.379598:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586ae00/0xf6a94c97d6611152 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x25c1b92c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360943.379697:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:11567:x1875232130426368:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1083us (1465us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788360943.379706:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00100000:0.0:1788360943.386415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.386490:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130426496 00000100:00100000:2.0:1788360943.386501:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130426496 00000100:00100000:1.0:1788360943.386587:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00100000:1.0:1788360943.386599:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+61:11567:x1875232130426496:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788360943.386620:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360943.386640:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6611159 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e555 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.386672:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.386684:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.386695:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.386804:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705ac00/0xf6a94c97d6611159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e555 expref: 63 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.386822:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e555 expref: 62 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.386843:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8abc8ce000) 00010000:00010000:1.0:1788360943.386846:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788360943.386851:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705bc00, rc 0) 00000100:00100000:1.0:1788360943.386959:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+62:11567:x1875232130426496:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 362us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360943.386966:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00100000:1.0:1788360943.406706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.407220:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130426752 00000100:00100000:2.0:1788360943.407234:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130426752 00000100:00100000:2.0:1788360943.407516:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 222 00000100:00100000:2.0:1788360943.407529:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+62:11567:x1875232130426752:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788360943.407631:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.407653:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.407680:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788360943.407954:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1788360943.407966:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333422879245ns, next at 334422875986ns, rc = 0 00000004:00010000:2.0:1788360943.408075:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001daae3a1 reply state 00000000f66b9f7b transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360943.408148:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788360943.408248:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+64:11567:x1875232130426752:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 721us (1550us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788360943.408257:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 222 00010000:00010000:0.0:1788360943.413807:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.413825:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.413847:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.413853:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360943.413858:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.413866:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.413882:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8abc8ce000) 00010000:00010000:0.0:1788360943.413886:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788360943.413891:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.413909:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6611167 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360943.414785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360943.414855:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130426880 00000100:00100000:0.0:1788360943.414864:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130426880 00000100:00100000:0.0:1788360943.414920:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:0.0:1788360943.414930:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+63:11567:x1875232130426880:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788360943.414955:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360943.414979:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661116e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e55c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.415055:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661116e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e55c expref: 64 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.415109:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661116e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e55c expref: 64 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.415135:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8abc8ce000) 00010000:00010000:0.0:1788360943.415138:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788360943.415141:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43e00, rc 0) 00000100:00100000:0.0:1788360943.415194:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+64:11567:x1875232130426880:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 265us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360943.415201:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:0.0:1788360943.425955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.426152:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130427008 00000100:00100000:2.0:1788360943.426165:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130427008 00000100:00100000:2.0:1788360943.426283:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:2.0:1788360943.426295:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987c49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2349:x1875232130427008:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788360943.426588:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987c49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:2349:x1875232130427008:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 294us (644us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788360943.426597:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:3.0:1788360943.429734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360943.429996:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130427264 00000100:00100000:0.0:1788360943.430006:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130427264 00000100:00100000:0.0:1788360943.430078:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:0.0:1788360943.430117:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+64:11567:x1875232130427264:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788360943.430368:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+65:11567:x1875232130427264:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 280us (644us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788360943.430377:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:3.0:1788360943.433638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360943.433889:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130427520 00000100:00100000:1.0:1788360943.433898:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130427520 00000100:00100000:1.0:1788360943.433953:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:1.0:1788360943.433963:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+65:11567:x1875232130427520:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788360943.434399:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+65:11567:x1875232130427520:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 434us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360943.434408:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:0.0:1788360943.446122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360943.446258:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130427648 00000100:00100000:1.0:1788360943.446280:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130427648 00000100:00100000:1.0:1788360943.446347:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:1.0:1788360943.446359:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+65:11567:x1875232130427648:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788360943.446382:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360943.446404:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6611175 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e563 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.446475:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d661117c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.446502:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d661117c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.446515:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d661117c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788360943.446555:0:6736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360943.446577:0:6736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d661117c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.446609:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a800/0xf6a94c97d6611175 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e563 expref: 67 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.446629:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d661117c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e563 expref: 66 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.446639:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8abc8ce000) 00010000:00010000:1.0:1788360943.446642:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788360943.446645:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b600, rc 0) 00000100:00100000:1.0:1788360943.446713:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+66:11567:x1875232130427648:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 356us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360943.446721:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:3.0:1788360943.449282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.449380:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130427776 00000100:00100000:2.0:1788360943.449388:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130427776 00000100:00100000:2.0:1788360943.449450:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:2.0:1788360943.449459:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+10:2349:x1875232130427776:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788360943.449476:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360943.449494:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f7eabc5/0xf6a94c97d6611183 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e56a expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788360943.449536:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9838f0, blocks: 0x1 00010000:00010000:2.0:1788360943.449554:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1788360943.449558:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360943.449566:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f7eabc5/0xf6a94c97d6611183 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e56a expref: 11 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.449582:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009f7eabc5/0xf6a94c97d6611183 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e56a expref: 11 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.449595:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45000, rc 0) 00000100:00100000:2.0:1788360943.449650:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:2349:x1875232130427776:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 192us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360943.449657:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:3.0:1788360943.453705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360943.453899:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130428032 00000100:00100000:0.0:1788360943.453911:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130428032 00000100:00100000:0.0:1788360943.453976:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 226 00000100:00100000:0.0:1788360943.453987:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+66:11567:x1875232130428032:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788360943.454135:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+66:11567:x1875232130428032:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 150us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360943.454160:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 226 00000100:00100000:1.0:1788360943.466576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360943.466670:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130428160 00000100:00100000:3.0:1788360943.466693:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130428160 00000100:00100000:3.0:1788360943.466808:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:3.0:1788360943.466820:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:11567:x1875232130428160:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788360943.466839:0:9606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360943.466856:0:9606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e571 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.466889:0:9606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f7eabc5/0xf6a94c97d6611183 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e56a expref: 12 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.466898:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788360943.466903:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788360943.466909:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 12 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.466946:0:9606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f7eabc5/0xf6a94c97d6611183 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e56a expref: 12 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.466959:0:9606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f7eabc5/0xf6a94c97d6611183 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e56a expref: 12 pid: 6593 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360943.466973:0:9606:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144037376:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788360943.467122:0:9606:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788360943.475976:0:9606:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144037376:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360943.476012:0:9606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 12 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.476068:0:9606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586ae00, rc 0) 00000100:00100000:1.0:1788360943.476163:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:11567:x1875232130428160:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 9345us (9598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360943.476172:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1788360943.477670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360943.478548:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130428288 00000100:00100000:0.0:1788360943.478560:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130428288 00010000:00010000:0.0:1788360943.478603:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f7eabc5/0xf6a94c97d6611183 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e56a expref: 12 pid: 6593 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360943.478651:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:0.0:1788360943.478662:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:2350:x1875232130428288:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360943.478680:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360943.478704:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f7eabc5/0xf6a94c97d6611183 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e56a expref: 12 pid: 6593 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.478718:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f7eabc5/0xf6a94c97d6611183 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e56a expref: 12 pid: 6593 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.478744:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f7eabc5/0xf6a94c97d6611183 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e56a expref: 12 pid: 6593 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.478773:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360943.478778:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360943.478786:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 11 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.478797:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 11 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.478866:0:5784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 11 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360943.478881:0:5784:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5784:1875232144037504:192.168.203.60@tcp:105: 00000100:00100000:0.0:1788360943.478977:0:5784:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788360943.485524:0:5784:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5784:1875232144037504:192.168.203.60@tcp:105: 00010000:00010000:3.0:1788360943.485554:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360943.485608:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:2350:x1875232130428288:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 6948us (7944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360943.485631:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1788360943.486401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360943.486716:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130428416 00000100:00100000:0.0:1788360943.486725:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130428416 00002000:00100000:0.0:1788360943.486782:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9a8ab6ceb100 x1875232130428416/t0(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:4/0 lens 504/0 e 0 to 0 dl 1788360954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788360943.486793:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6ceb100 with x1875232130428416 ext(0->12) 00002000:00010000:0.0:1788360943.486798:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6ceb100 00000100:00100000:2.0:1788360943.486948:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788360943.486961:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+11:2350:x1875232130428416:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788360943.487440:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:2350:x1875232130428416:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 481us (1048us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788360943.487450:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00002000:00100000:2.0:1788360943.487457:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9a8ab6ceb100 x1875232130428416/t4294967320(0) o4->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:4/0 lens 504/448 e 0 to 0 dl 1788360954 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788360943.487466:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6ceb100 with x1875232130428416 ext(0->12) 00002000:00010000:2.0:1788360943.487470:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6ceb100 00000100:00100000:3.0:1788360943.491033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360943.491281:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130428544 00000100:00100000:1.0:1788360943.491290:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130428544 00000100:00100000:1.0:1788360943.491343:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:1.0:1788360943.491352:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+66:11567:x1875232130428544:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788360943.551262:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788360943.551284:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788360943.551300:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a84dab780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788360943.551305:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a882b6f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a84dab240 00000020:00080000:0.0:1788360943.551308:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a882b6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ac0d05400 00000020:00080000:0.0:1788360943.551326:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a84f90240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788360943.551329:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ab7666600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a84f90300 00000020:00080000:0.0:1788360943.551332:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ab7666b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ab7151c00 00000004:00080000:0.0:1788360943.551341:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788360943.551479:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788360943.551667:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788360943.552138:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:11567:x1875232130428544:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 60782us (61119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360943.552151:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:2.0:1788360943.552392:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788360943.552420:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144037632:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788360943.552474:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360943.552549:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144037632 00000100:00100000:2.0:1788360943.552556:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144037632 00000100:00100000:2.0:1788360943.552602:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788360943.552612:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144037632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788360943.552637:0:6593:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1788360943.552670:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9838ee, atime: 0x6a9838ee, ctime: 0x6a9838ee, blocks: 0x1 00010000:00010000:2.0:1788360943.552678:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6611191 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.552694:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1788360943.552699:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360943.552706:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6611191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.552723:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6611191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.552734:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6611191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.552742:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6611191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.552768:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788360943.553678:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1875232144037632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1066us (1200us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788360943.553693:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:2.0:1788360943.553724:0:11019:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360943.553731:0:11019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6611191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.553741:0:11019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788360943.553746:0:11019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6611191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.553768:0:11019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6611191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.553786:0:11019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6611191 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.553794:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6611191 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.553814:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360943.553816:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360943.553817:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360943.554152:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788360943.554167:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144037760:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788360943.554204:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360943.559627:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788360943.559663:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144037888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788360943.560209:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360943.560264:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144037760 00000100:00100000:1.0:1788360943.560281:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144037760 00000100:00100000:1.0:1788360943.560335:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144037888 00000100:00100000:1.0:1788360943.560338:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144037888 00000100:00100000:1.0:1788360943.560359:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788360943.560369:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144037760:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788360943.560474:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1788360943.560499:0:9606:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1788360943.560523:0:9606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.560566:0:9606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d6610f53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d0 expref: 12 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.560580:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788360943.560585:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788360943.560589:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.560625:0:9606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d6610f53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d0 expref: 12 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.560640:0:9606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d6610f53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d0 expref: 12 pid: 6594 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360943.560907:0:9606:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144038016:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788360943.560979:0:9606:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83f11300 going to sleep for 11 seconds 00000100:00100000:0.0:1788360943.561746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360943.564479:0:9606:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144038016:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360943.564511:0:9606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360943.564875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360943.564942:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130428800 00000100:00100000:1.0:1788360943.564950:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130428800 00010000:00010000:1.0:1788360943.564985:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d6610f53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d0 expref: 13 pid: 6594 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360943.565056:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1788360943.565064:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:2350:x1875232130428800:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360943.565079:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360943.565118:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d6610f53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d0 expref: 13 pid: 6594 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.565131:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d6610f53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d0 expref: 13 pid: 6594 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.565152:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e937f4a/0xf6a94c97d6610f53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4d0 expref: 13 pid: 6594 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.565168:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788360943.565172:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788360943.565178:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.565187:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.565207:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360943.565257:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+12:2350:x1875232130428800:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 193us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360943.565695:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130428672 00000100:00100000:2.0:1788360943.565702:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130428672 00000100:00100000:2.0:1788360943.565731:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788360943.565739:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144037888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788360943.565945:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788360943.565956:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788360944 00002000:00010000:2.0:1788360943.565958:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788360943.565960:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788360944 -> 1788360944 00002000:00010000:2.0:1788360943.565963:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788360943.566024:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1875232144037888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 286us (5816us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788360943.566032:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788360943.566052:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:2.0:1788360943.566059:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+13:2349:x1875232130428672:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788360943.566166:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a90b2dc00/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788360943.566174:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144037888:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1788360943.566939:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8985092680/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788360943.566948:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144037632:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788360943.567671:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00010000:00010000:0.0:1788360943.569963:0:9606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.569982:0:9606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.569996:0:9606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.570005:0:9606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.570041:0:9606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788360943.570254:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788360943.570273:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.570292:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ba00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788360943.570297:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.570308:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.570330:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.570509:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008191d15d/0xf6a94c97d6611198 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.570549:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360943.570553:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360943.570557:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360943.572166:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3311:x1875232144037760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11789us (17951us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788360943.572179:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1788360943.572298:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a90b2d180/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788360943.572306:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144037760:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788360943.622788:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:0.0:1788360943.622814:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1788360943.623156:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1788360943.623377:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130428672:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 57312us (61628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360943.623388:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:3.0:1788360943.625957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360943.626061:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130429056 00000100:00100000:0.0:1788360943.626073:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130429056 00000100:00100000:0.0:1788360943.626165:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00100000:0.0:1788360943.626176:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:11567:x1875232130429056:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788360943.626243:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360943.626653:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b600/0xf6a94c97d661117c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e563 expref: 20 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.626695:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8abc8ce000) 00010000:00010000:0.0:1788360943.626701:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788360943.626733:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.626757:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.626768:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788360943.627037:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab740a5a reply state 00000000d2410463 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360943.627047:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788360943.627186:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:11567:x1875232130429056:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1012us (1239us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788360943.627195:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 228 00010000:00010000:0.0:1788360943.629536:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.629553:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.629561:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.629568:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360943.629573:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.629600:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.629619:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8abc8ce000) 00010000:00010000:0.0:1788360943.629623:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360943.629628:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.629633:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d661119f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360943.632447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.632537:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130429184 00000100:00100000:2.0:1788360943.632547:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130429184 00000100:00100000:2.0:1788360943.632605:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1788360943.632615:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2352:x1875232130429184:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788360943.632938:0:6594:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788360943.632942:0:6594:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788360944 -> 1788360943 00002000:00010000:2.0:1788360943.632944:0:6594:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788360942 00002000:00010000:2.0:1788360943.632946:0:6594:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788360944 -> 1788360943 00002000:00010000:2.0:1788360943.632949:0:6594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788360943.633023:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2352:x1875232130429184:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 408us (585us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788360943.633032:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:1.0:1788360943.637139:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360943.637927:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130429440 00000100:00100000:2.0:1788360943.637938:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130429440 00000100:00100000:2.0:1788360943.638000:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:2.0:1788360943.638010:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:11567:x1875232130429440:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788360943.638117:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.638134:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e555 expref: 20 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.638143:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.638178:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e555 expref: 20 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.638191:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e555 expref: 20 pid: 6736 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360943.638206:0:5797:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985092a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144038144:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360943.638606:0:5797:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788360943.647066:0:5797:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985092a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1875232144038144:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360943.647174:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360943.651481:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360943.653321:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130429568 00000100:00100000:3.0:1788360943.653336:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130429568 00010000:00010000:3.0:1788360943.653378:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e555 expref: 21 pid: 6736 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360943.653428:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788360943.653439:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:2349:x1875232130429568:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360943.653455:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360943.653463:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e555 expref: 21 pid: 6736 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.653479:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e555 expref: 21 pid: 6736 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.653531:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705bc00/0xf6a94c97d6611160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e555 expref: 21 pid: 6736 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.653547:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8abc8ce000) 00010000:00010000:3.0:1788360943.653553:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.653563:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.653570:0:8303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.653599:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360943.653671:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:2349:x1875232130429568:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 233us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360943.653679:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00010000:00010000:2.0:1788360943.654430:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.654442:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.654471:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.654478:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.654485:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.654490:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360943.654494:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.654501:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.654514:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8abc8ce000) 00010000:00010000:2.0:1788360943.654517:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788360943.654521:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.654526:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360943.654594:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:11567:x1875232130429440:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 16584us (17465us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788360943.654613:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:1.0:1788360943.660463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360943.660629:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130429696 00000100:00100000:0.0:1788360943.660641:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130429696 00000100:00100000:0.0:1788360943.660699:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:0.0:1788360943.660709:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2349:x1875232130429696:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788360943.660764:0:9606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.660786:0:9606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 8 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.660796:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788360943.660800:0:9606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788360943.660805:0:9606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.660841:0:9606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 8 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.660875:0:9606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 8 pid: 9606 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360943.660891:0:9606:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144038272:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360943.660983:0:9606:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788360943.666533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360943.666688:0:9606:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9606:1875232144038272:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788360943.666716:0:9606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360943.667882:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130429824 00000100:00100000:3.0:1788360943.667895:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130429824 00010000:00010000:2.0:1788360943.668105:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 9 pid: 9606 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360943.668152:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:2.0:1788360943.668161:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+9:2349:x1875232130429824:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360943.668177:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360943.668199:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 9 pid: 9606 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.668213:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 9 pid: 9606 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.668237:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d661118a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e571 expref: 9 pid: 9606 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.668254:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788360943.668258:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788360943.668263:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.668273:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.668306:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360943.668388:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2349:x1875232130429824:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 227us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360943.668396:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00010000:00010000:1.0:1788360943.668763:0:9606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.668773:0:9606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.668799:0:9606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.668807:0:9606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.668815:0:9606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.668823:0:9606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788360943.668827:0:9606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.668837:0:9606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.668851:0:9606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.668873:0:9606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a01993f/0xf6a94c97d66111ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360943.668946:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2349:x1875232130429696:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 8238us (8494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360943.668956:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:0.0:1788360943.676037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360943.676814:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130430080 00000100:00100000:3.0:1788360943.676826:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130430080 00000100:00100000:3.0:1788360943.676935:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 230 00000100:00100000:3.0:1788360943.676947:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:11567:x1875232130430080:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788360943.677037:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.677058:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.677119:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.677365:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.677378:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661116e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e55c expref: 20 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.677386:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.677423:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661116e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e55c expref: 20 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360943.677436:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661116e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e55c expref: 20 pid: 5799 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360943.677451:0:5798:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985092a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1875232144038400:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788360943.677606:0:5798:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788360943.684728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360943.684869:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130430208 00000100:00100000:1.0:1788360943.684881:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130430208 00010000:00010000:1.0:1788360943.684922:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661116e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e55c expref: 21 pid: 5799 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360943.684933:0:5798:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985092a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1875232144038400:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788360943.684959:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360943.684976:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:1.0:1788360943.684987:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:2350:x1875232130430208:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788360943.685005:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360943.685012:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661116e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e55c expref: 21 pid: 5799 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.685029:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661116e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e55c expref: 21 pid: 5799 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.685054:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d661116e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e55c expref: 21 pid: 5799 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.685070:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8abc8ce000) 00010000:00010000:1.0:1788360943.685075:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.685322:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.685330:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.685364:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360943.685419:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:2350:x1875232130430208:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 434us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360943.685428:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00010000:00010000:3.0:1788360943.685519:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.685528:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788360943.685724:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788360943.685891:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788360943.685936:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788360943.686022:0:5798:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5798:1875232144038528:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788360943.686072:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360943.686137:0:5798:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788360943.686704:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144038528 00000100:00100000:1.0:1788360943.686711:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144038528 00000100:00100000:1.0:1788360943.686773:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788360943.686782:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1875232144038528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788360943.686880:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1875232144038528:12345-0@lo:1000:mdt00_001.0 Request processed in 98us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360943.686887:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788360943.687117:0:5798:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1788360943.687123:0:5798:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1788360943.687141:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a90b2dc00, transno 4294967321 00000100:00100000:3.0:1788360943.687162:0:5798:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8a90b2d180 x1875232144037760/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788360959 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360943.687173:0:5798:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5798:1875232144038528:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788360943.687700:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788360943.687791:0:5798:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5798:1875232144038656:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788360943.687846:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360943.687873:0:5798:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788360943.689009:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144038656 00000100:00100000:1.0:1788360943.689020:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144038656 00000100:00100000:1.0:1788360943.689073:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788360943.689082:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1875232144038656:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788360943.689393:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5798:x1875232144038656:12345-0@lo:1000:mdt00_001.0 Request processed in 311us (1548us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788360943.689401:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788360943.692072:0:5798:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5798:1875232144038656:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788360943.692151:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692182:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692190:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692196:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360943.692201:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692209:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692226:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8abc8ce000) 00010000:00010000:3.0:1788360943.692230:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788360943.692234:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692240:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d66111bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692290:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692297:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692303:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692308:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360943.692318:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692324:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692334:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788360943.692336:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788360943.692344:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611105 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e540 expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692357:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611105 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e540 expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692367:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e540 expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.692407:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e540 expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360943.692423:0:5798:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1875232144038784:192.168.203.60@tcp:105: 00000100:00100000:3.0:1788360943.692508:0:5798:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788360943.695419:0:5798:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1875232144038784:192.168.203.60@tcp:105: 00010000:00010000:3.0:1788360943.695450:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695460:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705a600/0xf6a94c97d66110fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695515:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695529:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695540:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695551:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695558:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695565:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695571:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586be00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360943.695575:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695582:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695592:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788360943.695595:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788360943.695599:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695605:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695624:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695631:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695637:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695642:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586a400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788360943.695645:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695651:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695659:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788360943.695662:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788360943.695665:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.695671:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360943.695921:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:11567:x1875232130430080:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 18974us (19899us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788360943.695932:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 230 00000020:00080000:3.0:1788360943.695938:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788360943.695995:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788360943.696000:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788360943.696559:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788360943.696572:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788360943.698384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360943.698528:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130430464 00000100:00100000:0.0:1788360943.698539:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130430464 00000100:00100000:0.0:1788360943.698598:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:0.0:1788360943.698609:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+23:11567:x1875232130430464:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788360943.699145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360943.699244:0:5800:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1788360943.699253:0:5800:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00080000:0.0:1788360943.699410:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1788360943.699509:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130430592 00000100:00100000:1.0:1788360943.699519:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130430592 00000001:00080000:0.0:1788360943.699538:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788360943.699594:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.699611:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.699623:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.699631:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.699638:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360943.699641:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:3.0:1788360943.699653:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84eaa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:11566:x1875232130430592:12345-192.168.203.60@tcp:49:lfs.0 00010000:00010000:0.0:1788360943.699654:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.699684:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788360943.699771:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788360943.699778:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.699787:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788360943.699791:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.699800:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.699813:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a8a983bf700) 00010000:00010000:1.0:1788360943.699816:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788360943.699820:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.699826:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66111c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360943.699841:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360943.699842:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360943.699844:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360943.699887:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84eaa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:11566:x1875232130430592:12345-192.168.203.60@tcp:49:lfs.0 Request processed in 237us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360943.699894:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1788360943.700596:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+25:11567:x1875232130430464:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1984us (2216us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788360943.700604:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000020:00080000:0.0:1788360943.700608:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788360943.712413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360943.712488:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130430848 00000100:00100000:3.0:1788360943.712498:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130430848 00000100:00100000:3.0:1788360943.712560:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:3.0:1788360943.712570:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+25:11566:x1875232130430848:12345-192.168.203.60@tcp:58:lfs.0 00000040:00080000:3.0:1788360943.712845:0:6736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788360943.712936:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+25:11566:x1875232130430848:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 367us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360943.712944:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:1.0:1788360943.748183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360943.748379:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130430976 00000100:00100000:0.0:1788360943.748389:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130430976 00000100:00100000:0.0:1788360943.748475:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 232 00000100:00100000:0.0:1788360943.748485:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+25:11569:x1875232130430976:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360943.748512:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360943.748531:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d66111d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e578 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.748589:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66111d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.748603:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66111d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.748615:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66111d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.748628:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66111de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.748635:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66111de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.748657:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66111de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.748957:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.748968:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e539 expref: 26 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.748976:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.749014:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e539 expref: 26 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.749028:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e539 expref: 26 pid: 5799 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360943.749042:0:5799:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144038912:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788360943.749160:0:5799:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788360943.752261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360943.752343:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130431232 00000100:00100000:3.0:1788360943.752355:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130431232 00000100:00100000:3.0:1788360943.752409:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:3.0:1788360943.752419:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:5559:x1875232130431232:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788360943.752804:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:5559:x1875232130431232:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 385us (551us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788360943.752813:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:0.0:1788360943.753418:0:5799:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1875232144038912:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788360943.753446:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788360943.755189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360943.755519:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130431360 00000100:00100000:3.0:1788360943.755530:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130431360 00010000:00010000:3.0:1788360943.755567:0:8303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e539 expref: 28 pid: 5799 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788360943.755609:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:3.0:1788360943.755628:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:2350:x1875232130431360:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788360943.755643:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360943.755650:0:8303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e539 expref: 28 pid: 5799 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.755662:0:8303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e539 expref: 28 pid: 5799 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.755684:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66110f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e539 expref: 28 pid: 5799 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.755700:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788360943.755705:0:8303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.755715:0:8303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.755722:0:8303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360943.755760:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360943.755812:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:2350:x1875232130431360:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 185us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360943.755819:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00010000:00010000:0.0:1788360943.756817:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.756829:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360943.756898:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788360943.756902:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788360943.756922:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.756937:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.756944:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66111d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.756948:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66111d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.756953:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66111d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.756957:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360943.756959:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66111d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.756964:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66111d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.756972:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:0.0:1788360943.756974:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360943.756977:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66111d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.756980:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d66111d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.756998:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66111de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.757002:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66111de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.757005:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66111de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.757008:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360943.757010:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66111de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.757013:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66111de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.757027:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a8a983bf000) 00010000:00010000:0.0:1788360943.757028:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788360943.757030:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66111de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.757033:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43600/0xf6a94c97d66111de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.757063:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42a00/0xf6a94c97d66111d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e578 expref: 27 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.757074:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e578 expref: 26 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360943.757109:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:0.0:1788360943.757111:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788360943.757112:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42600, rc 0) 00000100:00100000:0.0:1788360943.757157:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:11569:x1875232130430976:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 8672us (9078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360943.757166:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 232 00010000:00010000:2.0:1788360944.353758:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788360944.470708:0:12413:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788360944.470721:0:12413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788360944.471877:0:12413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 5 00000040:00080000:2.0:1788360944.471888:0:12413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788360944.736360:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788360944.736370:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788360944.736409:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 5 00000040:00080000:2.0:1788360944.736418:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788360944.736561:0:11534:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8985092a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144039040:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788360944.736732:0:11534:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788360944.753915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360944.753993:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130431488 00000100:00100000:1.0:1788360944.754004:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130431488 00000100:00100000:1.0:1788360944.754061:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:1.0:1788360944.754070:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:11582:x1875232130431488:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788360944.754156:0:6736:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788360944.754274:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:11582:x1875232130431488:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 203us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360944.754281:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:2.0:1788360944.754578:0:11534:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8985092a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11534:1875232144039040:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788360944.756958:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360944.757128:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130431744 00000100:00100000:3.0:1788360944.757138:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130431744 00000100:00100000:3.0:1788360944.757343:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 234 00000100:00100000:3.0:1788360944.757368:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+26:11582:x1875232130431744:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788360944.757389:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788360944.757409:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e57f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360944.757507:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360944.757521:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360944.757532:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788360944.757543:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788360944.757666:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586a400/0xf6a94c97d66111ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e57f expref: 29 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360944.757681:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e57f expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360944.757689:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788360944.757691:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788360944.757695:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586be00, rc 0) 00000100:00100000:3.0:1788360944.757771:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:11582:x1875232130431744:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 407us (822us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788360944.757777:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 234 00000100:00100000:2.0:1788360944.764230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360944.764319:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130431872 00000100:00100000:0.0:1788360944.764333:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130431872 00000100:00100000:0.0:1788360944.764400:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788360944.764410:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:2349:x1875232130431872:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360944.764426:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360944.764455:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a898586be00/0xf6a94c97d66111f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e57f expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360944.764476:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:0.0:1788360944.764481:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360944.764547:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:2349:x1875232130431872:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 138us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360944.764554:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1788360944.766496:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360944.766548:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130432128 00000100:00100000:0.0:1788360944.766557:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130432128 00000100:00100000:0.0:1788360944.766615:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:0.0:1788360944.766625:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+27:11582:x1875232130432128:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788360944.766715:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6611201 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360944.766756:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6611201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360944.766769:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6611201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360944.766997:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6611201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360944.767007:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6611201 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360944.767014:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6611201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360944.767021:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788360944.767025:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6611201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360944.767032:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6611201 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360944.767046:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788360944.767055:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788360944.767060:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6611201 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360944.767068:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43c00/0xf6a94c97d6611201 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788360944.767678:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:11582:x1875232130432128:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 1051us (1185us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788360944.767688:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 235 00000040:00080000:2.0:1788360944.769042:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788360944.769050:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788360944.769692:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1788360944.769705:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788360944.770773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360944.770821:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130432384 00000100:00100000:0.0:1788360944.770831:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130432384 00000100:00100000:0.0:1788360944.770876:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:0.0:1788360944.770886:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+28:11582:x1875232130432384:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788360944.771140:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:11582:x1875232130432384:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 253us (371us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788360944.771148:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000001:00080000:1.0:1788360945.375563:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788360945.375594:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1788360945.376625:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360945.825192:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788360945.825217:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144039168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788360945.825301:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360945.825376:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144039168 00000100:00100000:0.0:1788360945.825383:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144039168 00000100:00100000:0.0:1788360945.825436:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788360945.825445:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144039168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788360945.825481:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360945.825526:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144039168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360945.825533:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788360945.825572:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788360945.825577:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a8926d880, transno 4294967307 00000004:00080000:0.0:1788360945.825597:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788360945.825618:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8985092680, transno 4294967310 00000100:00100000:0.0:1788360945.825630:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144039168:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788360945.826153:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788360945.831958:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144039296:0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.832026:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360945.832064:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144039808:0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.832106:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360945.832133:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788360945.832140:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144039424:0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.832168:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360945.832202:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144039296 00000100:00100000:0.0:1788360945.832209:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144039296 00000100:00100000:0.0:1788360945.832256:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788360945.832266:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144039296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.832482:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144039296:12345-0@lo:400:kworker.0 Request processed in 216us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360945.832490:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788360945.832528:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144039808 00000100:00100000:0.0:1788360945.832531:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144039808 00000100:00100000:0.0:1788360945.832569:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788360945.832575:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144039808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.832607:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144039808:12345-0@lo:400:kworker.0 Request processed in 32us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360945.832613:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788360945.832630:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144039424 00000100:00100000:0.0:1788360945.832634:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144039424 00000100:00100000:0.0:1788360945.832670:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788360945.832675:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144039424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.832720:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144039424:12345-0@lo:400:kworker.0 Request processed in 44us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360945.832726:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788360945.832766:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788360945.832801:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144039424:0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.832813:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144039296:0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.832824:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144039808:0@lo:400:kworker.0 00000100:00100000:2.0:1788360945.832852:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144039680:0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.832857:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144039552:0@lo:400:kworker.0 00000100:00100000:2.0:1788360945.833079:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360945.833121:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144039680 00000100:00100000:0.0:1788360945.833126:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144039680 00000100:00100000:0.0:1788360945.833163:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788360945.833171:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144039680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.833271:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144039680:12345-0@lo:400:kworker.0 Request processed in 101us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360945.833278:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1788360945.833309:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360945.833319:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360945.833344:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144039552 00000100:00100000:0.0:1788360945.833347:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144039552 00000100:00100000:0.0:1788360945.833372:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788360945.833377:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144039552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788360945.833409:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144039552:12345-0@lo:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360945.833426:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1788360945.833441:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360945.833461:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144039552:0@lo:400:kworker.0 00000100:00100000:2.0:1788360945.834818:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144039680:0@lo:400:kworker.0 00000100:00100000:3.0:1788360946.339261:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788360946.339298:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144039936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788360946.339371:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360946.340121:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144039936 00000100:00100000:0.0:1788360946.340130:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144039936 00000100:00100000:0.0:1788360946.340187:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788360946.340197:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144039936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788360946.340234:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360946.340300:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144039936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360946.340308:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788360946.340402:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144039936:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788360946.371383:0:12468:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788360946.371394:0:12468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788360946.371520:0:12468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 5 00000040:00080000:3.0:1788360946.371525:0:12468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788360946.401994:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360946.557317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360946.558694:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130432640 00000100:00100000:0.0:1788360946.558707:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130432640 00000100:00100000:0.0:1788360946.558836:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 236 00000100:00100000:0.0:1788360946.558847:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+29:11602:x1875232130432640:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788360946.558877:0:6736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788360946.558902:0:6736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6611208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e586 expref: -99 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.559016:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661120f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.559031:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661120f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.559044:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661120f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788360946.559076:0:6736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788360946.559230:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42400/0xf6a94c97d6611208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e586 expref: 32 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.559253:0:6736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661120f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e586 expref: 31 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.559262:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:0.0:1788360946.559265:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788360946.559269:0:6736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43800, rc 0) 00000100:00100000:0.0:1788360946.559343:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+31:11602:x1875232130432640:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 496us (2035us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788360946.559351:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 236 00000100:00080000:2.0:1788360946.559421:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360946.563562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360946.567294:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130432768 00000100:00100000:1.0:1788360946.567309:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130432768 00000100:00100000:0.0:1788360946.567411:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:0.0:1788360946.567422:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+31:11602:x1875232130432768:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:0.0:1788360946.567490:0:6736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661121d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.567508:0:6736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661121d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.567520:0:6736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661121d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.567650:0:6736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661121d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.567658:0:6736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661121d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.567677:0:6736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661121d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.567683:0:6736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788360946.567687:0:6736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661121d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.567695:0:6736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661121d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.567707:0:6736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:0.0:1788360946.567710:0:6736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788360946.567714:0:6736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661121d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360946.567720:0:6736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43400/0xf6a94c97d661121d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788360946.567797:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11e5d128-044a-45c3-b501-2dba6e5a82fa+31:11602:x1875232130432768:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 376us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360946.567804:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:3.0:1788360946.639659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360946.639755:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130432896 00000100:00100000:2.0:1788360946.639764:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130432896 00000100:00100000:2.0:1788360946.639834:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:2.0:1788360946.639844:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2352:x1875232130432896:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:2.0:1788360946.639862:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788360946.639881:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611224 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e58d expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788360946.639909:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9838ef, atime: 0x6a9838ee, ctime: 0x6a9838ef, blocks: 0xb 00010000:00010000:2.0:1788360946.639946:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1788360946.639951:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788360946.639960:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611224 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e58d expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360946.639976:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611224 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e58d expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360946.639990:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45200, rc 0) 00000100:00100000:2.0:1788360946.640219:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2352:x1875232130432896:12345-192.168.203.60@tcp:101:cat.0 Request processed in 376us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360946.640226:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:2.0:1788360946.643234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360946.643346:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130433024 00000100:00100000:1.0:1788360946.643355:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130433024 00002000:00100000:1.0:1788360946.643402:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9a89871b3800 x1875232130433024/t0(0) o3->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:7/0 lens 488/0 e 0 to 0 dl 1788360957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788360946.643413:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89871b3800 with x1875232130433024 ext(0->4095) 00002000:00010000:1.0:1788360946.643418:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89871b3800 00000100:00100000:1.0:1788360946.643452:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788360946.643461:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89871b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2351:x1875232130433024:12345-192.168.203.60@tcp:3:cat.0 00000100:00100000:1.0:1788360946.643673:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89871b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2351:x1875232130433024:12345-192.168.203.60@tcp:3:cat.0 Request processed in 212us (450us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788360946.643680:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00002000:00100000:1.0:1788360946.643686:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9a89871b3800 x1875232130433024/t0(0) o3->11e5d128-044a-45c3-b501-2dba6e5a82fa@192.168.203.60@tcp:7/0 lens 488/4536 e 0 to 0 dl 1788360957 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788360946.643694:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89871b3800 with x1875232130433024 ext(0->4095) 00002000:00010000:1.0:1788360946.643703:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89871b3800 00000100:00080000:0.0:1788360946.645608:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788360946.850483:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788360946.850493:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788360946.850633:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788360946.850640:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788360947.343962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360947.344082:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130433152 00000100:00100000:1.0:1788360947.344108:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130433152 00000100:00100000:1.0:1788360947.344168:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 284 00000100:00100000:1.0:1788360947.344177:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2352:x1875232130433152:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360947.348147:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2352:x1875232130433152:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 2807us (3032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360947.348162:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 284 00000100:00100000:3.0:1788360947.349209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360947.349383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360947.349420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360947.349445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360947.349495:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130433408 00000100:00100000:1.0:1788360947.349505:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130433408 00000100:00100000:1.0:1788360947.349562:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130433536 00000100:00100000:1.0:1788360947.349566:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130433536 00000100:00100000:1.0:1788360947.349596:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:1.0:1788360947.349605:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2352:x1875232130433408:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360947.349674:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2352:x1875232130433408:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 70us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360947.349681:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:1.0:1788360947.349696:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:1.0:1788360947.349701:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2351:x1875232130433536:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360947.349740:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+8:2351:x1875232130433536:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360947.349746:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00080000:1.0:1788360947.349771:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788360947.357628:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130433280 00000100:00100000:0.0:1788360947.357643:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130433280 00000100:00100000:0.0:1788360947.357708:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130433664 00000100:00100000:0.0:1788360947.357711:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130433664 00000100:00100000:0.0:1788360947.357768:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:0.0:1788360947.357779:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+31:2351:x1875232130433280:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360947.357877:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+31:2351:x1875232130433280:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 100us (8672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360947.357895:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:0.0:1788360947.357915:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:0.0:1788360947.357921:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2352:x1875232130433664:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360947.357949:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2352:x1875232130433664:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 27us (8502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360947.357956:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00080000:0.0:1788360947.358130:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788360947.428256:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360948.448264:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788360948.985957:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1788360948.985976:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788360948.986241:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1788360948.996753:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788360948.996789:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788360948.996846:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a85678a80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788360948.996851:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a87cd4a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a9269f300 00000020:00080000:0.0:1788360948.996855:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a87cd4d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ab7061000 00000020:00080000:1.0:1788360948.996958:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788360948.997230:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788360949.472305:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360950.498233:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360950.783634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360950.783719:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130433792 00000100:00100000:0.0:1788360950.783729:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130433792 00000100:00100000:0.0:1788360950.783798:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 238 00000100:00100000:0.0:1788360950.783809:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:11255:x1875232130433792:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788360950.783913:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:11255:x1875232130433792:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 105us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360950.783921:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 238 00000100:00080000:1.0:1788360950.784039:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360950.791058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360950.791121:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130434048 00000100:00100000:3.0:1788360950.791131:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130434048 00000100:00100000:3.0:1788360950.791190:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:3.0:1788360950.791201:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:11255:x1875232130434048:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788360950.791722:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:11255:x1875232130434048:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 522us (671us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788360950.791731:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:0.0:1788360950.944670:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144040320:0@lo:400:kworker.0 00000100:00100000:0.0:1788360950.944767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360950.944834:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144040832:0@lo:400:kworker.0 00000100:00100000:0.0:1788360950.944859:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360950.944886:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788360950.944892:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144040448:0@lo:400:kworker.0 00000100:00100000:0.0:1788360950.944913:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360950.945126:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144040320 00000100:00100000:1.0:1788360950.945135:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144040320 00000100:00100000:1.0:1788360950.945185:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144040448 00000100:00100000:1.0:1788360950.945188:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144040448 00000100:00100000:1.0:1788360950.945222:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788360950.945231:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144040320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360950.945289:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144040320:12345-0@lo:400:kworker.0 Request processed in 60us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360950.945297:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788360950.945313:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788360950.945320:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144040448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360950.945346:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144040448:12345-0@lo:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360950.945352:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788360950.945370:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144040832 00000100:00100000:1.0:1788360950.945373:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144040832 00000100:00100000:1.0:1788360950.945403:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788360950.945409:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144040832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360950.945439:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144040832:12345-0@lo:400:kworker.0 Request processed in 31us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360950.945445:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788360950.945467:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788360950.945470:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788360950.945500:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144040448:0@lo:400:kworker.0 00000100:00100000:1.0:1788360950.945510:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144040320:0@lo:400:kworker.0 00000100:00100000:1.0:1788360950.945529:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788360950.945534:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a90b2d180, transno 4294967322 00000004:00080000:1.0:1788360950.945546:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788360950.945568:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144040832:0@lo:400:kworker.0 00000100:00100000:2.0:1788360950.945838:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144040064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360950.945880:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360950.945909:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144040576:0@lo:400:kworker.0 00000100:00100000:2.0:1788360950.945947:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360950.945970:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788360950.945977:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144040192:0@lo:400:kworker.0 00000100:00100000:2.0:1788360950.946001:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360950.946026:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144040704:0@lo:400:kworker.0 00000100:00100000:2.0:1788360950.946056:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360950.946082:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144040064 00000100:00100000:2.0:1788360950.946111:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144040064 00000100:00100000:2.0:1788360950.946147:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788360950.946154:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144040064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788360950.946179:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788360950.946216:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144040064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360950.946222:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788360950.946233:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144040192 00000100:00100000:1.0:1788360950.946238:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144040192 00000100:00080000:2.0:1788360950.946244:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788360950.946270:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144040064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788360950.946275:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788360950.946287:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144040192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360950.946301:0:6736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144040704 00000100:00100000:2.0:1788360950.946305:0:6736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144040704 00000100:00100000:1.0:1788360950.946341:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3313:x1875232144040192:12345-0@lo:400:kworker.0 Request processed in 55us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360950.946342:0:6736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788360950.946355:0:6736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144040704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360950.946356:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788360950.946394:0:9606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144040576 00000100:00100000:2.0:1788360950.946400:0:6736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144040704:12345-0@lo:400:kworker.0 Request processed in 49us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360950.946400:0:9606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144040576 00000100:00100000:2.0:1788360950.946409:0:6736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1788360950.946432:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788360950.946433:0:9606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788360950.946443:0:9606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144040576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360950.946452:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144040192:0@lo:400:kworker.0 00000100:00100000:2.0:1788360950.946467:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144040704:0@lo:400:kworker.0 00000100:00100000:1.0:1788360950.946480:0:9606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144040576:12345-0@lo:400:kworker.0 Request processed in 38us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360950.946486:0:9606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788360950.946691:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144040576:0@lo:400:kworker.0 00000100:00100000:3.0:1788360950.948229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360950.948745:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130434176 00000100:00100000:1.0:1788360950.948755:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130434176 00000100:00100000:1.0:1788360950.948833:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:1.0:1788360950.948843:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:12053:x1875232130434176:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:1.0:1788360950.948863:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788360950.948884:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661122b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e594 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360950.948962:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6611232 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360950.949112:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6611232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360950.949124:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6611232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788360950.949476:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788360950.949516:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788360950.949520:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788360950.949605:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6611232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360950.949632:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705aa00/0xf6a94c97d661122b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e594 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360950.949650:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6611232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e594 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360950.949658:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1300) 00010000:00010000:1.0:1788360950.949661:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788360950.949665:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b200, rc 0) 00000100:00100000:1.0:1788360950.949736:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:12053:x1875232130434176:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 893us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360950.949743:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:2.0:1788360951.456400:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788360951.456422:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144040960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788360951.456509:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360951.456772:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144040960 00000100:00100000:0.0:1788360951.456781:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144040960 00000100:00100000:0.0:1788360951.456834:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788360951.456843:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144040960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788360951.456879:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360951.456936:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144040960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360951.456943:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788360951.457112:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144040960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788360951.520239:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360952.459205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360952.459257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360952.459356:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130434304 00000100:00100000:0.0:1788360952.459365:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130434304 00000100:00100000:0.0:1788360952.459432:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 286 00000100:00100000:0.0:1788360952.459442:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2351:x1875232130434304:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360952.459512:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2351:x1875232130434304:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 71us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360952.459519:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 286 00000100:00100000:1.0:1788360952.460435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360952.460468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360952.460497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360952.460542:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130434816 00000100:00100000:3.0:1788360952.460548:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130434816 00000100:00100000:3.0:1788360952.460591:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130434432 00000100:00100000:3.0:1788360952.460605:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130434432 00000100:00100000:3.0:1788360952.460634:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:3.0:1788360952.460642:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2351:x1875232130434816:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360952.460704:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2351:x1875232130434816:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 63us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360952.460711:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:3.0:1788360952.460727:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:3.0:1788360952.460733:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:2351:x1875232130434432:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788360952.460762:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:2351:x1875232130434432:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360952.460768:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00080000:3.0:1788360952.460871:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788360952.462502:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130434560 00000100:00100000:0.0:1788360952.462514:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130434560 00000100:00080000:3.0:1788360952.462571:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788360952.462574:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130434688 00000100:00100000:0.0:1788360952.462579:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130434688 00000100:00100000:0.0:1788360952.462612:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788360952.462621:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2351:x1875232130434560:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:3.0:1788360952.462666:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788360952.462709:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2351:x1875232130434560:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 88us (3451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360952.462716:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788360952.462733:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:0.0:1788360952.462740:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2351:x1875232130434688:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788360952.462764:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2351:x1875232130434688:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360952.462771:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00010000:00010000:1.0:1788360952.546941:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360953.568819:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788360953.596465:0:12669:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:55:53 (1788360953) 00000020:00080000:0.0:1788360954.044454:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1788360954.044540:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788360954.044564:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788360954.044575:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788360954.592236:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360955.616289:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788360956.064383:0:11534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788360956.064395:0:11534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788360956.064954:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788360956.064962:0:11534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788360956.065535:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788360956.065555:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144041088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788360956.065631:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360956.065728:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144041216:0@lo:400:kworker.0 00000100:00100000:1.0:1788360956.065765:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360956.065796:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144041344:0@lo:400:kworker.0 00000100:00100000:0.0:1788360956.065832:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360956.065836:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144041600:0@lo:400:kworker.0 00000100:00100000:2.0:1788360956.065883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360956.067992:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144041472:0@lo:400:kworker.0 00000100:00100000:3.0:1788360956.068075:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360956.068271:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144041728:0@lo:400:kworker.0 00000100:00100000:1.0:1788360956.068311:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360956.068358:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144041088 00000100:00100000:1.0:1788360956.068366:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144041088 00000100:00100000:1.0:1788360956.068431:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788360956.068440:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144041088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788360956.068478:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788360956.068530:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144041088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360956.068537:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788360956.068577:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144041216 00000100:00100000:1.0:1788360956.068582:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144041216 00000100:00100000:1.0:1788360956.068609:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788360956.068615:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144041216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360956.068669:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144041216:12345-0@lo:400:kworker.0 Request processed in 46us (2896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360956.068677:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788360956.068721:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144041344 00000100:00100000:1.0:1788360956.068725:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144041344 00000100:00100000:1.0:1788360956.068750:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144041472 00000100:00100000:1.0:1788360956.068753:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144041472 00000100:00100000:1.0:1788360956.068777:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144041728 00000100:00100000:1.0:1788360956.068780:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144041728 00000100:00100000:1.0:1788360956.068795:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788360956.068807:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144041344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788360956.069240:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144041344:12345-0@lo:400:kworker.0 Request processed in 433us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360956.069247:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788360956.069262:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788360956.069268:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144041472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360956.069386:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144041600 00000100:00100000:2.0:1788360956.069393:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144041600 00000100:00100000:0.0:1788360956.069401:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144041344:0@lo:400:kworker.0 00000100:00100000:0.0:1788360956.069414:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144041856:0@lo:400:kworker.0 00000100:00100000:3.0:1788360956.069426:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788360956.069433:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788360956.069439:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144041728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360956.069446:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144041600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788360956.069485:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144041728:12345-0@lo:400:kworker.0 Request processed in 50us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360956.069491:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788360956.069517:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788360956.069522:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788360956.069555:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144041600:12345-0@lo:400:kworker.0 Request processed in 114us (3670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360956.069564:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788360956.069574:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144041600:0@lo:400:kworker.0 00000100:00100000:0.0:1788360956.069724:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360956.069751:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144041216:0@lo:400:kworker.0 00000100:00100000:2.0:1788360956.069769:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144041728:0@lo:400:kworker.0 00000100:00100000:2.0:1788360956.069786:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144041088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788360956.069960:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144041856 00000100:00100000:2.0:1788360956.069964:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144041856 00000100:00100000:2.0:1788360956.070015:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788360956.070021:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144041856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788360956.070057:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144041856:12345-0@lo:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360956.070063:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788360956.070781:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788360956.070922:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144041856:0@lo:400:kworker.0 00000100:00100000:1.0:1788360956.071171:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144041472:12345-0@lo:400:kworker.0 Request processed in 1900us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360956.071181:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788360956.071187:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144041472:0@lo:400:kworker.0 00000100:00100000:3.0:1788360956.504334:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360956.504766:0:12375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130435072 00000100:00100000:1.0:1788360956.504776:0:12375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130435072 00000100:00100000:1.0:1788360956.504857:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:1.0:1788360956.504868:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+18:12274:x1875232130435072:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:1.0:1788360956.505429:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:12274:x1875232130435072:12345-192.168.203.60@tcp:35:umount.0 Request processed in 562us (1104us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788360956.505438:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00080000:0.0:1788360956.507292:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788360956.513538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788360956.513788:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130435328 00000100:00100000:1.0:1788360956.513799:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130435328 00000100:00100000:1.0:1788360956.513860:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:1.0:1788360956.513870:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+19:12274:x1875232130435328:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:1.0:1788360956.514273:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:12274:x1875232130435328:12345-192.168.203.60@tcp:35:umount.0 Request processed in 404us (743us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788360956.514281:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:3.0:1788360956.520342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360956.524449:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130435584 00000100:00100000:2.0:1788360956.524464:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130435584 00000100:00100000:2.0:1788360956.524534:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:2.0:1788360956.524545:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84eaa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+20:12274:x1875232130435584:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:2.0:1788360956.525323:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84eaa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:12274:x1875232130435584:12345-192.168.203.60@tcp:35:umount.0 Request processed in 777us (4988us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788360956.525332:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:0.0:1788360956.532122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360956.532367:0:12375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130435840 00000100:00100000:3.0:1788360956.532377:0:12375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130435840 00000100:00100000:3.0:1788360956.532469:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:3.0:1788360956.532480:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:12274:x1875232130435840:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:3.0:1788360956.532857:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:12274:x1875232130435840:12345-192.168.203.60@tcp:35:umount.0 Request processed in 379us (777us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788360956.532865:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:3.0:1788360956.537537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360956.537582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360956.537614:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360956.537646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360956.537709:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130435968 00000100:00100000:2.0:1788360956.537719:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130435968 00000100:00100000:0.0:1788360956.537737:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130436224 00000100:00100000:0.0:1788360956.537744:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130436224 00000100:00100000:2.0:1788360956.537831:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130436096 00000100:00100000:2.0:1788360956.537835:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130436096 00000100:00100000:0.0:1788360956.541731:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788360956.541757:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee34693-2e5d-4e3f-a247-33b45ac274f5+15:2352:x1875232130435968:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360956.541778:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360956.541813:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586a000/0xf6a94c97d6610248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e11f expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360956.541831:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360956.541952:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee34693-2e5d-4e3f-a247-33b45ac274f5+14:2352:x1875232130435968:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 206us (4367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360956.541960:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788360956.542297:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1788360956.542305:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee34693-2e5d-4e3f-a247-33b45ac274f5+13:2352:x1875232130436224:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360956.542314:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360956.542324:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d66104a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ea expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360956.542334:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360956.542355:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:2352:x1875232130436224:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 51us (4740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360956.542361:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1788360956.542375:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788360956.542382:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:2352:x1875232130436096:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788360956.542388:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360956.542398:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586a200/0xf6a94c97d6610210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e0e7 expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360956.542406:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788360956.542423:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2352:x1875232130436096:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 41us (4776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360956.542429:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788360956.542845:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130436608 00000100:00100000:0.0:1788360956.542855:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130436608 00000100:00100000:0.0:1788360956.543027:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:0.0:1788360956.543193:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+7:2348:x1875232130436608:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:0.0:1788360956.543217:0:6592:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66107ea 00000020:00010000:0.0:1788360956.543223:0:6592:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8abccc6000: total 0 00000100:00080000:0.0:1788360956.543227:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a8abccc3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788360956.543265:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788360956.543554:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2348:x1875232130436608:12345-192.168.203.60@tcp:9:umount.0 Request processed in 364us (6026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360956.543562:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00000020:00010000:0.0:1788360956.543581:0:11019:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8abccc6000: total 0 00010000:00010000:0.0:1788360956.543601:0:11019:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8abccc6000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788360956.543643:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005638d9be/0xf6a94c97d6610b86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3bf expref: 4 pid: 9606 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360956.543687:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611224 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e58d expref: 3 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360956.543702:0:11019:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8abccc6000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788360956.543713:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360956.543715:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360956.543717:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788360956.543725:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788360956.547964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360956.548139:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130436736 00000100:00100000:2.0:1788360956.548151:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130436736 00000100:00100000:2.0:1788360956.548239:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00080000:0.0:1788360956.548245:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788360956.548251:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+5:2348:x1875232130436736:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:2.0:1788360956.548283:0:6594:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6610582 00000100:00080000:2.0:1788360956.548291:0:6594:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a10b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788360956.548335:0:6594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1788360956.548347:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360956.548622:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+2:2348:x1875232130436736:12345-192.168.203.60@tcp:9:umount.0 Request processed in 373us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360956.548630:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788360956.558429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360956.558518:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130437760 00000100:00100000:3.0:1788360956.558528:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130437760 00000100:00100000:3.0:1788360956.558589:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 240 00000100:00100000:3.0:1788360956.558599:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+22:2348:x1875232130437760:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:3.0:1788360956.558640:0:5799:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661021e 00000020:00010000:3.0:1788360956.558673:0:5799:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a8a585000: total 0 00000100:00080000:3.0:1788360956.558678:0:5799:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a582000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788360956.558696:0:5799:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1788360956.559124:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11e5d128-044a-45c3-b501-2dba6e5a82fa+21:2348:x1875232130437760:12345-192.168.203.60@tcp:39:umount.0 Request processed in 525us (703us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788360956.559132:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 240 00000020:00010000:1.0:1788360956.559353:0:5786:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a8a585000: total 0 00010000:00010000:1.0:1788360956.559405:0:5786:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a8a585000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788360956.559444:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:1.0:1788360956.559448:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788360956.559459:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6610504 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1ff expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559486:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1300) 00010000:00010000:1.0:1788360956.559489:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788360956.559492:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6610be8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3db expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559509:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360956.559512:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360956.559516:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6610b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3aa expref: 18 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559543:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360956.559546:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788360956.559551:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b800/0xf6a94c97d6610b71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3b8 expref: 17 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559562:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:1.0:1788360956.559565:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788360956.559568:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42600/0xf6a94c97d66111e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e578 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559579:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:1.0:1788360956.559582:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788360956.559586:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d661120f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e586 expref: 15 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559597:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360956.559599:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788360956.559602:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b400/0xf6a94c97d6610845 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e2e6 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559612:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a983bf900) 00010000:00010000:1.0:1788360956.559614:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788360956.559616:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66104e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1f8 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559629:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:1.0:1788360956.559631:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788360956.559640:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d6610ee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e4b4 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559653:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a8a983bf100) 00010000:00010000:1.0:1788360956.559656:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788360956.559676:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d6610558 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e214 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559692:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:1.0:1788360956.559694:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788360956.559702:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6611105 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e540 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559793:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:1.0:1788360956.559796:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788360956.559801:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6610c04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e3e2 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559816:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a8a99640c00) 00010000:00010000:1.0:1788360956.559822:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788360956.559826:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6610a67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e372 expref: 8 pid: 6736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360956.559839:0:5786:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a8a585000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788360956.559852:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360956.559854:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360956.559856:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360956.576727:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788360956.577968:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144041984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788360956.578059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788360956.578237:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144041984 00000100:00100000:0.0:1788360956.578246:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144041984 00000100:00100000:0.0:1788360956.578289:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788360956.578298:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144041984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788360956.578336:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788360956.578380:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144041984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360956.578386:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788360956.578524:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144041984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788360956.640938:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360957.578433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360957.578673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360957.578798:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130438016 00000100:00100000:2.0:1788360957.578808:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130438016 00000100:00100000:2.0:1788360957.578881:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:2.0:1788360957.578891:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2349:x1875232130438016:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788360957.578967:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2349:x1875232130438016:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 78us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360957.578986:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00080000:0.0:1788360957.579123:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788360957.581362:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130437888 00000100:00100000:1.0:1788360957.581376:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130437888 00000100:00100000:1.0:1788360957.581553:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 288 00000100:00100000:1.0:1788360957.581562:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2349:x1875232130437888:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788360957.581641:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2349:x1875232130437888:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (2968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360957.581647:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 288 00010000:00010000:0.0:1788360957.665479:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360957.922157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360957.922212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360957.922252:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788360957.924612:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130438272 00000100:00100000:2.0:1788360957.924629:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130438272 00000100:00100000:2.0:1788360957.925113:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130438144 00000100:00100000:2.0:1788360957.925118:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130438144 00000100:00100000:2.0:1788360957.932815:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130438400 00000100:00100000:2.0:1788360957.932835:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130438400 00000100:00100000:2.0:1788360957.932903:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1788360957.932914:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bee34693-2e5d-4e3f-a247-33b45ac274f5+12:2349:x1875232130438272:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360957.932948:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360957.932969:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66102f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e15e expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360957.932987:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360957.933060:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bee34693-2e5d-4e3f-a247-33b45ac274f5+11:2349:x1875232130438272:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 148us (10913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360957.933068:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1788360957.933117:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788360957.933153:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bee34693-2e5d-4e3f-a247-33b45ac274f5+10:2350:x1875232130438144:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360957.933163:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360957.933172:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586b400/0xf6a94c97d66102f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e134 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360957.933182:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360957.933202:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bee34693-2e5d-4e3f-a247-33b45ac274f5+9:2350:x1875232130438144:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 78us (10989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360957.933209:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788360957.933288:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:2.0:1788360957.933297:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bee34693-2e5d-4e3f-a247-33b45ac274f5+8:2350:x1875232130438400:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788360957.933306:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360957.933316:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573ea00/0xf6a94c97d661048d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e1e3 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360957.933324:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360957.933340:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bee34693-2e5d-4e3f-a247-33b45ac274f5+7:2350:x1875232130438400:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 45us (11087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360957.933346:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:2.0:1788360957.934188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788360957.934252:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130438656 00000100:00100000:3.0:1788360957.934260:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130438656 00000100:00100000:3.0:1788360957.934405:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 241 00000100:00100000:3.0:1788360957.934415:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+6:2348:x1875232130438656:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:3.0:1788360957.934449:0:5799:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6610305 00000020:00010000:3.0:1788360957.934457:0:5799:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8ab76da000: total 0 00000100:00080000:3.0:1788360957.934461:0:5799:0:(import.c:65:import_set_state_nolock()) ffff9a8ab76db800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788360957.934487:0:5799:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788360957.934707:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67937cdd-2aa9-412f-a448-3db0f2b2b807+5:2348:x1875232130438656:12345-192.168.203.60@tcp:39:umount.0 Request processed in 293us (520us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788360957.934714:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 241 00000020:00010000:1.0:1788360957.934766:0:5786:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8ab76da000: total 0 00010000:00010000:1.0:1788360957.934770:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360957.934809:0:5786:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8ab76da000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788360957.934835:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1300) 00010000:00010000:1.0:1788360957.934838:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788360957.934845:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab705b200/0xf6a94c97d6611232 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e594 expref: 4 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360957.934868:0:5786:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8ab76da000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788360957.934877:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360957.934879:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788360957.934881:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360957.950221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788360957.950329:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130438912 00000100:00100000:0.0:1788360957.950340:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130438912 00000100:00100000:0.0:1788360957.950406:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 289 00000100:00100000:0.0:1788360957.950416:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+7:2348:x1875232130438912:12345-192.168.203.60@tcp:251:umount.0 00000020:00000080:0.0:1788360957.950466:0:5792:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66101fb 00000020:00010000:0.0:1788360957.950474:0:5792:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a8a581800: total 0 00000100:00080000:0.0:1788360957.950478:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a584800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788360957.950559:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee34693-2e5d-4e3f-a247-33b45ac274f5+3:2348:x1875232130438912:12345-192.168.203.60@tcp:251:umount.0 Request processed in 143us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360957.950567:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 289 00000020:00010000:2.0:1788360957.950811:0:11019:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a8a581800: total 0 00010000:00010000:2.0:1788360957.950863:0:11019:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a8a581800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788360957.950899:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661024f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e126 expref: 2 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360957.950913:0:11019:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a8a581800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788360957.950998:0:11019:0:(genops.c:906:class_export_put()) final put ffff9a8a8a581800/bee34693-2e5d-4e3f-a247-33b45ac274f5 00010000:00010000:2.0:1788360957.951063:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360957.951066:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360957.951067:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788360957.952454:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a581800/bee34693-2e5d-4e3f-a247-33b45ac274f5 for MGS 00000020:00000080:1.0:1788360957.953063:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a584800 for MGS 00010000:00010000:0.0:1788360958.688427:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788360959.176509:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:3.0:1788360959.176520:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8abccc6000/11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:1.0:1788360959.177880:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abccc6000/11e5d128-044a-45c3-b501-2dba6e5a82fa for lustre-OST0001 00000020:00000080:1.0:1788360959.179037:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8abccc3800 for lustre-OST0001 00000001:00080000:3.0:1788360959.198370:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00080000:3.0:1788360959.198389:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:3.0:1788360959.198400:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 67937cdd-2aa9-412f-a448-3db0f2b2b807 00000001:00080000:3.0:1788360959.198406:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788360959.198410:0:5819:0:(genops.c:906:class_export_put()) final put ffff9a8ab76da000/67937cdd-2aa9-412f-a448-3db0f2b2b807 00000001:00100000:3.0:1788360959.198425:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000001:00080000:3.0:1788360959.198429:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788360959.198433:0:5819:0:(genops.c:906:class_export_put()) final put ffff9a8a8a585000/11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:3.0:1788360959.198445:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76da000/67937cdd-2aa9-412f-a448-3db0f2b2b807 for lustre-MDT0000 00000020:00000080:3.0:1788360959.198499:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a585000/11e5d128-044a-45c3-b501-2dba6e5a82fa for lustre-MDT0000 00000020:00000080:3.0:1788360959.198547:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ab76db800 for lustre-MDT0000 00000020:00000080:3.0:1788360959.198552:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a582000 for lustre-MDT0000 00000020:01000004:0.0:1788360959.489425:0:12871:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788360959.503505:0:12871:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788360959.503577:0:12871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360959.503609:0:12871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360959.503617:0:12871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360959.503624:0:12871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360959.503664:0:12871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788360959.503671:0:12871:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788360959.503698:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788360959.503702:0:12871:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788360959.503707:0:12871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788360959.503732:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9a8a8675c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788360959.503844:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144042112:0@lo:39:umount.0 00010000:00010000:3.0:1788360959.503948:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788360959.503956:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.503965:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586b800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360959.503968:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.503976:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360959.503983:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360959.503989:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788360959.503991:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788360959.503994:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788360959.504018:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.504026:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360959.504054:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.504062:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661028e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6610295 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.504076:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360959.504078:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360959.504120:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360959.504128:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788360959.504129:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360959.504145:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144042240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788360959.504188:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788360959.504236:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144042240 00000100:00100000:3.0:1788360959.504244:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144042240 00000100:00100000:3.0:1788360959.504306:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788360959.504315:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3314:x1875232144042240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788360959.504339:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788360959.504354:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1ea00/0xf6a94c97d6610295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661028e expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.504367:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360959.504401:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:3314:x1875232144042240:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360959.504408:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788360959.504457:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144042240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788360959.505006:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144042112 00000100:00100000:2.0:1788360959.505012:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144042112 00000100:00100000:2.0:1788360959.505280:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788360959.505290:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232144042112:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788360959.505837:0:5798:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661000a 00000100:00080000:2.0:1788360959.506181:0:5798:0:(import.c:65:import_set_state_nolock()) ffff9a8a8675b800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788360959.506294:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1875232144042112:12345-0@lo:39:umount.0 Request processed in 1004us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360959.506303:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788360959.506312:0:5798:0:(genops.c:906:class_export_put()) final put ffff9a8a8675a800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788360959.506653:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788360959.507404:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8675a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788360959.507558:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8675b800 for lustre-MDT0000 00000100:00080000:1.0:1788360959.509833:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8675c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788360959.509864:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144042112:0@lo:39:umount.0 00000100:00080000:0.0:1788360959.509924:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788360959.509929:0:12871:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788360959.509934:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788360959.512351:0:12871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512370:0:12871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512378:0:12871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512385:0:12871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512399:0:12871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788360959.512405:0:12871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512411:0:12871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512417:0:12871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512423:0:12871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512441:0:12871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788360959.512447:0:12871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512467:0:12871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512473:0:12871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512479:0:12871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512493:0:12871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788360959.512499:0:12871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512506:0:12871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512512:0:12871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512530:0:12871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.512537:0:12871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788360959.512540:0:12871:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788360959.512566:0:12871:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788360959.512570:0:12871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788360959.512574:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788360959.512580:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788360959.512586:0:12871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a8ab74b5800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788360959.512597:0:12871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a8ab6fb8800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788360959.512602:0:12871:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9a8ab77a0000) has exports, disconnecting them 00000020:00080000:0.0:1788360959.512607:0:12871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a8ab74b5800), last request at 1788360956 00000020:00000080:0.0:1788360959.512615:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661017d 00000100:00080000:0.0:1788360959.512635:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9a8ab74b1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788360959.512695:0:12871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8ab74b5800): rc 0 00000020:00000080:0.0:1788360959.512697:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8ab74b5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788360959.512709:0:12871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a8ab6fb8800), last request at 1788360956 00000020:00000080:0.0:1788360959.512713:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66100a4 00000100:00080000:0.0:1788360959.512719:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9a8ab6fb8000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788360959.512730:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab74b5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788360959.512769:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ab74b1000 for lustre-MDT0000 00000020:00080000:0.0:1788360959.512797:0:12871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8ab6fb8800): rc 0 00000020:00000080:0.0:1788360959.512799:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fb8800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788360959.512810:0:12871:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa998c1da7ae0 00000020:00000080:0.0:1788360959.512820:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fb8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788360959.512846:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ab6fb8000 for lustre-MDT0000 00000100:00080000:0.0:1788360959.512871:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788360959.512875:0:12871:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788360959.512889:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1788360959.512896:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788360959.512906:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.512916:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586b600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360959.512920:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.512930:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360959.512937:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360959.512951:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788360959.512953:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788360959.512956:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00080000:0.0:1788360959.512962:0:12871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788360959.512987:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788360959.512990:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.512999:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788360959.513004:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788360959.513008:0:12871:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788360959.513020:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1788360959.513027:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513035:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586b600/0xf6a94c97d661029c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66102a3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513047:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788360959.513051:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513057:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360959.513060:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513067:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360959.513074:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360959.513079:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788360959.513081:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788360959.513083:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788360959.513130:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513136:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788360959.513138:0:12871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788360959.513151:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9a89852f1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788360959.513154:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513162:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66101b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66101bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513175:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788360959.513178:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513184:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fe00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360959.513187:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788360959.513192:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a8ab77a0000) has no exports 00010000:00010000:3.0:1788360959.513194:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360959.513200:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360959.513206:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788360959.513208:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788360959.513210:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788360959.513221:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513226:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360959.513231:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513242:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d66104b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66104be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513251:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788360959.513254:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513260:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030a00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360959.513262:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513269:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360959.513275:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360959.513280:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788360959.513282:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788360959.513284:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788360959.513299:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513305:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360959.513311:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513316:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a80030a00/0xf6a94c97d660ff69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d660ff70 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.513339:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360959.513341:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360959.513343:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360959.513360:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144042624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788360959.513431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788360959.513495:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360959.513512:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788360959.513520:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144042880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788360959.513543:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788360959.513603:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360959.513636:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144042496:0@lo:9:umount.0 00000100:00100000:1.0:1788360959.513684:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360959.513709:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144042752:0@lo:9:umount.0 00000100:00100000:1.0:1788360959.513732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360959.513761:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144042496 00000100:00100000:1.0:1788360959.513768:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144042496 00000100:00100000:1.0:1788360959.514297:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144042752 00000100:00100000:1.0:1788360959.514303:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144042752 00000100:00100000:1.0:1788360959.514424:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788360959.514433:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144042496:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788360959.514457:0:6592:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66100f8 00000100:00080000:1.0:1788360959.514464:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a898534f800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788360959.516289:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144043008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788360959.516366:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144042368:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788360959.516712:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788360959.518017:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144042496:12345-0@lo:9:umount.0 Request processed in 3577us (4323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360959.518018:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788360959.518032:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788360959.518062:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788360959.518073:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144042752:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788360959.518117:0:6592:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66101e6 00000100:00080000:1.0:1788360959.518127:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a587800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788360959.518161:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788360959.519995:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144042752:12345-0@lo:9:umount.0 Request processed in 1917us (6252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360959.520008:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788360959.520053:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788360959.520059:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788360959.520079:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788360959.520147:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788360959.520169:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788360959.520171:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788360959.520175:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144042496:0@lo:9:umount.0 00000100:00080000:1.0:1788360959.520188:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89852f1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788360959.520197:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788360959.520198:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788360959.520201:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144042752:0@lo:9:umount.0 00000100:00100000:0.0:1788360959.521112:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144042624 00000100:00100000:0.0:1788360959.521122:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144042624 00000100:00100000:0.0:1788360959.521194:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144042880 00000100:00100000:0.0:1788360959.521198:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144042880 00000100:00100000:0.0:1788360959.521231:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788360959.521240:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d9fa3464-d771-4fa1-895d-6f4c1383568d+19:3311:x1875232144042624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788360959.521257:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788360959.521279:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813cb800/0xf6a94c97d66101bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66101b5 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360959.521300:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360959.521665:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788360959.521691:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+18:3311:x1875232144042880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788360959.521701:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788360959.521711:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d66104be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66104b7 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360959.521721:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788360959.522058:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:3311:x1875232144042880:12345-0@lo:103:ldlm_bl.0 Request processed in 367us (8513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788360959.522065:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788360959.522446:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:3311:x1875232144042624:12345-0@lo:103:ldlm_bl.0 Request processed in 1206us (9014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788360959.522453:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788360959.522589:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360959.522634:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144042880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788360959.522655:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d9fa3464-d771-4fa1-895d-6f4c1383568d:3311:1875232144042624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788360959.524269:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788360959.524318:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144043008 00000100:00100000:2.0:1788360959.524327:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144043008 00000100:00100000:2.0:1788360959.524419:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144042368 00000100:00100000:2.0:1788360959.524423:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144042368 00000100:00100000:3.0:1788360959.525035:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788360959.525047:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:3313:x1875232144043008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788360959.525066:0:8303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788360959.526488:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788360959.526507:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+17:3314:x1875232144042368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788360959.526523:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788360959.526540:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586aa00/0xf6a94c97d66102a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661029c expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360959.526557:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788360959.526626:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9fa3464-d771-4fa1-895d-6f4c1383568d+16:3314:x1875232144042368:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788360959.526633:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788360959.526696:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144042368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788360959.526914:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1f800/0xf6a94c97d660ff70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d660ff69 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.526933:0:8303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788360959.527019:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d9fa3464-d771-4fa1-895d-6f4c1383568d+14:3313:x1875232144043008:12345-0@lo:103:ldlm_bl.0 Request processed in 1975us (9002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788360959.527026:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788360959.527081:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144043008:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788360959.546064:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a8ab77a0000) has no exports 00000020:00000080:0.0:1788360959.619617:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660ffc4 00000020:00000080:0.0:1788360959.619633:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8abc485800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788360959.619667:0:12871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788360959.619759:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abc485800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788360959.621979:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788360959.621998:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788360959.622003:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9a8a857119c0) has no exports 00000020:00000080:1.0:1788360959.629381:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660ffbd 00000020:00000080:1.0:1788360959.629397:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788360959.629718:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788360959.629865:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788360959.629878:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788360959.629882:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8a9efdb000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788360959.629884:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efdb000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788360959.629893:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788360959.630057:0:12871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a8670d780 - data ffff9a8aa9be5870/ffff9a8abc8ba400 00000020:01000000:1.0:1788360959.630304:0:12871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a90b835a0 - data ffff9a8aa9835d80/ffff9a8a84e52800 00000001:00000004:1.0:1788360959.648910:0:12871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:2.0:1788360959.713997:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788360959.721554:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788360959.721572:0:12871:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788360959.721591:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788360959.721593:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788360959.722990:0:6734:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788360959.722996:0:6734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788360959.723008:0:6734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788360959.724368:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788360959.724374:0:12871:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788360959.724423:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788360959.724426:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788360959.724666:0:8050:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788360959.724670:0:8050:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788360959.724682:0:8050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788360959.811334:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660ff8c 00000020:00000080:2.0:1788360959.811350:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8a83562800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788360959.811453:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83562800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788360959.814449:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660ffa1 00000020:00000080:2.0:1788360959.814462:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8ab77b4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788360959.814635:0:12871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788360959.814659:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788360959.814668:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788360959.814673:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9a8ab77a19c0) has no exports 00000004:01000000:2.0:1788360959.814856:0:12871:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788360959.814866:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66101df 00000020:00000080:2.0:1788360959.814870:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8ab76df000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788360959.815068:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab77b4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788360959.815229:0:12871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788360959.815234:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788360959.815241:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788360959.815243:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9a8a90bf4d40) has no exports 00000020:00000080:2.0:1788360959.815250:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66101d8 00000020:00000080:2.0:1788360959.815255:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a89852f7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788360959.815274:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76df000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788360959.815675:0:12871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788360959.815689:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788360959.815693:0:12871:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788360959.815698:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788360959.815700:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788360959.815784:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89852f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788360959.816133:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788360959.816153:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788360959.816159:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66100ea 00000020:00000080:2.0:1788360959.816164:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a89852f1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788360959.816168:0:12871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788360959.816172:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788360959.816177:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788360959.816179:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a8a90bf3380) has no exports 00000020:00000080:2.0:1788360959.816183:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66100e3 00000020:00000080:2.0:1788360959.816187:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8abc48b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788360959.816665:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89852f1800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788360959.816672:0:38:0:(genops.c:906:class_export_put()) final put ffff9a8ab74b4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788360959.816683:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab74b4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788360959.816688:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788360959.816775:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89852f1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788360959.816782:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abc48b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788360959.816865:0:12871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788360959.816869:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788360959.816872:0:12871:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788360959.816882:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788360959.816884:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788360959.816993:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8abc48c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788360959.817035:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788360959.817041:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788360959.817045:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a89852f6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788360959.817048:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89852f6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788360959.817053:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788360959.817277:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788360959.817282:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788360959.817285:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8a9efc9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788360959.817288:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efc9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788360959.817295:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788360959.817435:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660ffa8 00000020:00000080:2.0:1788360959.817441:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8ab77b2800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788360959.817454:0:12871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788360959.817458:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788360959.817500:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab77b2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788360959.817527:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788360959.817530:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9a8ab77a3380) has no exports 00000020:00000080:2.0:1788360959.817551:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788360959.817555:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788360959.817558:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8a9efcb800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788360959.817560:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efcb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788360959.817564:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788360959.817712:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660ffaf 00000020:00000080:2.0:1788360959.817717:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8ab77b2000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788360959.817735:0:12871:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a83778000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788360959.817739:0:12871:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a83778000 3 00000020:01000004:2.0:1788360959.817743:0:12871:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8a83778000 from lustre-MDT0000 00000020:00000080:2.0:1788360959.817760:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788360959.817764:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788360959.817768:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8a83564000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788360959.817770:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83564000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788360959.817776:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788360959.817809:0:12871:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788360959.817813:0:12871:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788360959.817816:0:12871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788360959.817818:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788360959.817821:0:12871:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788360959.817828:0:12871:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9a8a83ec7800 d9fa3464-d771-4fa1-895d-6f4c1383568d 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788360959.817833:0:12871:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9a8a84f119c0) has exports, disconnecting them 00000020:00080000:2.0:1788360959.817837:0:12871:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a8a83ec7800), last request at 1788360782 00000020:00000080:2.0:1788360959.817851:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660ff4d 00000020:00010000:2.0:1788360959.817855:0:12871:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a83ec7800: total 1 00000100:00080000:2.0:1788360959.817858:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9a8a83ec2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788360959.817877:0:12871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a83ec7800): rc 0 00000020:00080000:2.0:1788360959.817881:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9a8a84f119c0) has no exports 00000020:00010000:3.0:1788360959.819484:0:5785:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a83ec7800: total 1 00010000:00010000:3.0:1788360959.819554:0:5785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a83ec7800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788360959.819590:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e200/0xf6a94c97d661049b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6610494 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.819612:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586a800/0xf6a94c97d661025d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6610256 expref: 8 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.819654:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813ca800/0xf6a94c97d661026b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6610264 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.819666:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d6610279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6610272 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.819675:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813cb600/0xf6a94c97d6610287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6610280 expref: 5 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.819686:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e600/0xf6a94c97d6610057 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6610050 expref: 4 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.819699:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a813cbc00/0xf6a94c97d66102b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66102aa expref: 3 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.819711:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573f200/0xf6a94c97d66104b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66104a9 expref: 2 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360959.819722:0:5785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a83ec7800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788360959.819736:0:5785:0:(genops.c:906:class_export_put()) final put ffff9a8a83ec7800/d9fa3464-d771-4fa1-895d-6f4c1383568d 00010000:00010000:3.0:1788360959.819745:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360959.819747:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360959.819749:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788360959.819966:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab77b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788360959.819976:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83ec7800/d9fa3464-d771-4fa1-895d-6f4c1383568d for MGS 00000020:00000080:0.0:1788360959.820019:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83ec2000 for MGS 00000100:00100000:1.0:1788360959.820403:0:5791:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a8a8358be00:5791] 1 exiting: rc = 0 00000100:00100000:0.0:1788360959.820536:0:5792:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a8a8358a400:5792] 2 exiting: rc = 0 00000100:00100000:3.0:1788360959.820611:0:5789:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a8a8358b000:5789] 0 exiting: rc = 1 00000100:00100000:2.0:1788360959.820668:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820680:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820686:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820694:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820702:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820709:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820717:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820727:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820737:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820745:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820754:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820762:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820771:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820780:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820788:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820869:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820879:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820886:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.820897:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821004:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821016:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821024:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821032:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821040:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821048:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821056:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821063:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821070:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821077:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821227:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821240:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821246:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821256:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821340:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821348:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821367:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821375:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821383:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821390:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821397:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821406:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821414:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821422:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821429:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821436:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821444:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821452:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821460:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821468:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821476:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821483:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821488:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821493:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821498:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821503:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821508:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821514:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821520:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821525:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821531:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821535:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821541:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821545:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.821549:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788360959.822848:0:12871:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788360959.822853:0:12871:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788360959.824288:0:12871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a83f30cc0 - data ffff9a8aa9b6a948/ffff9a898109e000 00000020:01000000:2.0:1788360959.824412:0:12871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a866065a0 - data ffff9a8ab0731d80/ffff9a8a8a5c7800 00000020:00000080:2.0:1788360959.824892:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660ff31 00000020:00000080:2.0:1788360959.824900:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8a85da8800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788360959.827003:0:12871:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a83778000 from MGS, refs=2 00000020:01000004:2.0:1788360959.827008:0:12871:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a83778000 2 00000020:01000004:2.0:1788360959.827012:0:12871:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8a83778000 from MGS 00000020:00000080:3.0:1788360959.827024:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85da8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788360959.827046:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788360959.827057:0:12871:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788360959.827061:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8a85dac800/MGS 00000020:00000080:2.0:1788360959.827064:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85dac800/MGS for MGS 00000020:01000000:2.0:1788360959.827241:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788360959.827491:0:12871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788360959.827496:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788360959.827502:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788360959.827508:0:12871:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a8ac1c6d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788360959.827515:0:12871:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9a8ab77a4d40) has exports, disconnecting them 00000020:00080000:2.0:1788360959.827519:0:12871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a8ac1c6d000), last request at 1788360783 00000020:00000080:2.0:1788360959.827524:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660fffc 00000020:00080000:2.0:1788360959.827537:0:12871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8ac1c6d000): rc 0 00000020:00000080:2.0:1788360959.827541:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788360959.827666:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788360959.829296:0:12871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788360959.829304:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788360959.829308:0:12871:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788360959.829324:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788360959.829460:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788360959.829467:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788360959.829474:0:12871:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a83778000 1 00000020:00000080:3.0:1788360959.829490:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660ff23 00000020:00000080:3.0:1788360959.829500:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8a85da8000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788360959.829505:0:12871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788360959.829518:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788360959.829522:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788360959.829525:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9a8a85710000) has no exports 00000020:00000080:0.0:1788360959.831045:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8675c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788360959.831057:0:8:0:(genops.c:906:class_export_put()) final put ffff9a8ab77b0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788360959.831061:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab77b0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788360959.831068:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788360959.831168:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85da8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788360959.875435:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788360959.875452:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788360959.875458:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8a8377a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788360959.875462:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8377a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788360959.875473:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788360959.875676:0:12871:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8a8377c000 00000020:01000000:0.0:1788360959.875697:0:12871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788360959.875701:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788360959.875706:0:12871:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788360959.875709:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9a8a85714d40) has no exports 00000100:00100000:0.0:1788360959.875795:0:6736:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a89858a9a00:6736] 3 exiting: rc = 0 00000100:00100000:1.0:1788360959.876277:0:5797:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a8a88337600:5797] 0 exiting: rc = 1 00000100:00100000:2.0:1788360959.876296:0:5798:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a8a88336800:5798] 1 exiting: rc = 0 00000100:00100000:2.0:1788360959.878238:0:5799:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a8a866b6c00:5799] 2 exiting: rc = 0 00000100:00100000:0.0:1788360959.880857:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.880870:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.880875:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.880892:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.880897:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.880994:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881007:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881013:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881019:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881024:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881030:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881036:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881041:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881047:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881052:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881057:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881063:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881069:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881075:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881082:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881310:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881324:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881793:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881802:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881810:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881817:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881825:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881832:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881840:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881847:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881854:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881862:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881869:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881877:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881886:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881893:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.881901:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882006:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882021:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882027:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882033:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882039:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882045:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882051:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882056:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882062:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882070:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882074:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882080:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882211:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882220:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882227:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882237:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882244:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882253:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882261:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882269:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882277:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882284:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882291:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882299:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882306:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882313:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.882331:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.888618:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a8a84f33600:5800] 0 exiting: rc = 1 00000100:00100000:3.0:1788360959.888754:0:12375:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9a8a8563fa00:12375] 2 exiting: rc = 0 00000100:00100000:0.0:1788360959.888849:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a8a84f33c00:5801] 1 exiting: rc = 0 00000100:00100000:2.0:1788360959.888889:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888904:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888912:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888920:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888928:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888935:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888944:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888951:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888960:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888968:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888976:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888985:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.888994:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.889014:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.889025:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.889034:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.889045:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890031:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890048:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890283:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890293:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890298:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890303:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890307:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890313:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890319:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890324:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890329:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890335:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890340:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890345:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890350:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890355:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890361:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890366:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890372:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890377:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890382:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890387:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890392:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890398:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890403:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890407:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890413:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890418:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890423:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890429:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890433:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890451:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890457:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890463:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890468:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890473:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890479:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890484:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890489:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890495:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890501:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890506:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890512:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890516:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890520:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.890526:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.891232:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.893622:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a8a84f33000:5803] 1 exiting: rc = 0 00000100:00100000:3.0:1788360959.894305:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a8a84f32200:5802] 0 exiting: rc = 1 00000100:00100000:2.0:1788360959.894438:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894446:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894460:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894466:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894472:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894477:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894483:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894489:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894495:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894500:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894506:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894512:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894518:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.894524:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895257:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895267:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895273:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895279:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895285:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895304:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895310:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895316:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895321:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895327:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895333:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895339:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895358:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895364:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895370:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895375:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895381:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895386:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895392:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895399:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895405:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895411:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895417:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895422:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895443:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895450:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895456:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895462:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895468:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895474:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895479:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895484:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895490:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895496:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895502:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895508:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895527:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895648:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895659:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895668:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895685:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895693:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895700:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895708:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895717:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895726:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895736:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895750:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895758:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.895768:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360959.918355:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a8a84f32400:5804] 0 exiting: rc = 1 00000100:00100000:1.0:1788360959.922631:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a8a84f32c00:5805] 1 exiting: rc = 0 00000100:00100000:3.0:1788360959.922804:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922812:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922817:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922822:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922827:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922832:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922838:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922843:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922848:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922853:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922858:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922863:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922869:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922873:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922879:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922884:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922889:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922894:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922899:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922904:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922908:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922927:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922931:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922936:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922941:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922946:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922951:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922956:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922961:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922965:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922971:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922976:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922981:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922986:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922990:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.922996:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923002:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923006:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923012:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923017:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923023:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923028:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923033:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923038:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923044:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923051:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923056:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923061:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923065:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923070:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923075:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923080:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923261:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923268:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923273:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923278:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923295:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923300:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923305:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923310:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923315:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923320:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923325:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788360959.923330:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.924566:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a8a84f32000:5807] 1 exiting: rc = 0 00000100:00100000:1.0:1788360959.925146:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a8a84f33200:5806] 0 exiting: rc = 1 00000100:00100000:2.0:1788360959.925326:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925334:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925350:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925355:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925360:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925364:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925369:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925380:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925384:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925389:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925394:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925399:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925818:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925823:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925828:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925833:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925838:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925843:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925848:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925853:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925858:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925863:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925868:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925872:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925892:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925897:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925902:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925907:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925911:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925915:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925920:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925924:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925928:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925933:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925938:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925942:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925946:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925950:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925954:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925958:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925963:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925968:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925973:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925978:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925982:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925987:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925991:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.925996:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926001:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926005:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926010:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926014:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926018:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926023:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926028:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926032:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926037:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926042:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926046:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926055:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926060:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926065:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926069:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926074:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360959.926698:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a8a84f33a00:5808] 0 exiting: rc = 1 00000100:00100000:3.0:1788360959.926716:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a8a84f32a00:5809] 1 exiting: rc = 0 00000100:00100000:2.0:1788360959.926828:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926834:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926839:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926843:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926849:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926853:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926859:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926864:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926868:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926873:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926878:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926883:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926888:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926893:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926898:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926903:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926907:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926912:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926917:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926921:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926926:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926931:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926936:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926941:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926946:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926951:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926956:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926961:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926966:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926970:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926987:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926992:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.926997:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927002:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927008:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927013:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927018:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927023:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927028:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927034:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927039:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927044:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927049:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927054:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927060:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927066:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927071:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927075:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927079:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927115:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927124:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927130:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927134:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927139:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927144:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927149:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927154:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927158:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927163:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927167:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927171:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927176:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927181:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927186:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.927652:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a8a834b6000:5812] 2 exiting: rc = 0 00000100:00100000:0.0:1788360959.927832:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a8a834b6600:5810] 0 exiting: rc = 1 00000100:00100000:3.0:1788360959.927936:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a8a834b7200:5811] 1 exiting: rc = 0 00000100:00100000:2.0:1788360959.928028:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928034:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928040:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928046:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928051:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928057:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928062:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928068:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928074:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928080:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928140:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928148:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928153:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928158:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928164:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928187:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928194:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928200:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928206:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928211:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928217:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928222:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928227:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928232:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928237:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928243:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928248:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928253:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928259:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928265:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928271:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928276:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928282:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928288:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928294:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928308:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928313:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928318:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928324:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928342:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928349:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928355:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928360:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928365:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928371:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928377:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928382:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928388:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928393:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928399:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928404:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928410:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928416:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928421:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928427:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928433:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928438:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928444:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928449:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928455:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928461:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928466:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928471:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788360959.928477:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788360959.933901:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788360959.933916:0:12871:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788360959.933922:0:12871:0:(genops.c:906:class_export_put()) final put ffff9a8a83565000/MDS_uuid 00000020:00000080:3.0:1788360959.933927:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83565000/MDS_uuid for MDS 00000020:01000000:3.0:1788360959.933939:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788360959.934314:0:12871:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:0.0:1788360960.738495:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788360960.738504:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8985349800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788360960.738538:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:0.0:1788360960.738541:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8a8a12e800/11e5d128-044a-45c3-b501-2dba6e5a82fa 00000020:00000080:3.0:1788360960.738777:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8985349800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788360960.738832:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a12e800/11e5d128-044a-45c3-b501-2dba6e5a82fa for lustre-OST0000 00000020:00000080:3.0:1788360960.738855:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a898534f800 for lustre-OST0000 00000020:00000080:3.0:1788360960.738861:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a10b000 for lustre-OST0000 00010000:00010000:0.0:1788360960.739138:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788360961.189605:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144043136:0@lo:400:kworker.0 00000400:00000100:0.0:1788360961.189682:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875232144043136 offset 0 length 224: 4 00000100:00100000:2.0:1788360961.189824:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144043392:0@lo:400:kworker.0 00000400:00000100:2.0:1788360961.189852:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144043392 offset 0 length 224: 4 00000100:00100000:2.0:1788360961.189873:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788360961.189879:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144043264:0@lo:400:kworker.0 00000400:00000100:2.0:1788360961.189913:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144043264 offset 0 length 224: 4 00010000:00010000:2.0:1788360961.760468:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788360962.583448:0:13022:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788360962.594225:0:13022:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788360962.594386:0:13022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360962.594403:0:13022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360962.594411:0:13022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360962.594417:0:13022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360962.594448:0:13022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788360962.594453:0:13022:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788360962.594478:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788360962.594483:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360962.594490:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a813caa00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360962.594493:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360962.594501:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360962.594508:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360962.594514:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788360962.594516:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788360962.594518:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788360962.594548:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360962.594554:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788360962.594576:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360962.594582:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a813caa00/0xf6a94c97d6610272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6610279 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360962.594593:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360962.594601:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360962.594603:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788360962.594632:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144043520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788360962.594696:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788360962.594765:0:13022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788360962.594773:0:13022:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a84854000 x1875232144043264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360977 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360962.594787:0:13022:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788360962.594811:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144043264:0@lo:400:kworker.0 00000100:00080000:3.0:1788360962.594834:0:13022:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788360962.594848:0:13022:0:(import.c:65:import_set_state_nolock()) ffff9a8a86758000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788360962.595368:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144043520 00000100:00100000:2.0:1788360962.595377:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144043520 00000100:00100000:2.0:1788360962.595417:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788360962.595424:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a856e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1875232144043520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788360962.595430:0:5783:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788360962 with bad export cookie 17773821619414826829 00000100:00100000:1.0:1788360962.595983:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144043648:0@lo:39:umount.0 00000400:00000100:1.0:1788360962.596037:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144043648 offset 0 length 224: 4 00000100:00100000:2.0:1788360962.612009:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a856e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1875232144043520:12345-0@lo:103:ldlm_bl.0 Request processed in 16577us (17305us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788360962.612024:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788360962.612333:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788360962.612339:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9a8a83563800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788360962.612343:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788360962.619525:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.160@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788360962.619530:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788360962.619540:0:3313:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a84857480 x1875232144043136/t0(0) o400->MGC192.168.203.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788360977 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788360962.619643:0:3313:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ac0a50e00 x1875232144043520/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788360978 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788360962.619654:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788360962.619657:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788360962.619658:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788360962.619662:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9a8a83563800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788360962.619667:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 172 00000100:00080000:3.0:1788360962.619675:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a8a83563800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788360962.619709:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0a52d80 x1875232144043776/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788360962.619762:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d9fa3464-d771-4fa1-895d-6f4c1383568d:3313:1875232144043520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788360962.619831:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d9fa3464-d771-4fa1-895d-6f4c1383568d:3310:1875232144043776:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788360962.619879:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875232144043776 offset 0 length 520: 4 00000100:00100000:0.0:1788360962.620081:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d9fa3464-d771-4fa1-895d-6f4c1383568d:3314:1875232144043136:0@lo:400:kworker.0 00010000:00010000:0.0:1788360962.787965:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360963.808414:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788360964.313814:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788360964.313825:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a8a586800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788360964.313968:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a586800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788360964.314210:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a587800 for lustre-OST0001 00010000:00010000:3.0:1788360964.832541:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360965.856316:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788360966.304666:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788360966.304673:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788360966.305515:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788360966.305536:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144043904:0@lo:400:kworker.0 00000400:00000100:3.0:1788360966.305588:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144043904 offset 0 length 224: 4 00010000:00010000:2.0:1788360966.880961:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788360967.328272:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788360967.328287:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788360967.330620:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144044032:0@lo:400:kworker.0 00000400:00000100:2.0:1788360967.330691:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144044032 offset 0 length 224: 4 00010000:00010000:3.0:1788360967.906057:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360968.930603:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360969.954318:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360970.976876:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360972.001952:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788360972.448219:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788360972.448230:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788360972.448354:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788360972.448371:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144044160:0@lo:400:kworker.0 00000400:00000100:2.0:1788360972.448428:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144044160 offset 0 length 224: 4 00000100:00100000:2.0:1788360972.960241:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788360962/real 1788360962] req@ffff9a8ac0a52d80 x1875232144043776/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788360972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360972.960277:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8ac0a52d80 x1875232144043776/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788360972 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360972.960288:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788360962/real 1788360962] req@ffff9a8ac0a52680 x1875232144043648/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788360972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360972.960301:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8ac0a52680 x1875232144043648/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788360972 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788360972.960335:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a83563800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788360972.960364:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788360972.960376:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d9fa3464-d771-4fa1-895d-6f4c1383568d:3310:1875232144043776:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788360972.960382:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a86758000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788360972.960400:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144043648:0@lo:39:umount.0 00000100:00080000:1.0:1788360972.960608:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788360972.960613:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788360972.960616:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a8a83563800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788360972.960621:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 352 00000100:00080000:1.0:1788360972.960627:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788360972.960633:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a8a83563800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788360972.960664:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0877480 x1875232144044288/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788360972.961051:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d9fa3464-d771-4fa1-895d-6f4c1383568d:3310:1875232144044288:0@lo:250:kworker.0 00000400:00000100:2.0:1788360972.961189:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875232144044288 offset 0 length 520: 4 00000100:00080000:3.0:1788360972.964390:0:13022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788360972.964399:0:13022:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788360972.964405:0:13022:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788360972.965389:0:13022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360972.965406:0:13022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360972.965414:0:13022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360972.965421:0:13022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360972.965452:0:13022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788360972.965459:0:13022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360972.965484:0:13022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360972.965491:0:13022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360972.965497:0:13022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360972.965520:0:13022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788360972.965525:0:13022:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788360972.965557:0:13022:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788360972.965562:0:13022:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788360972.965566:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788360972.965572:0:13022:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788360972.965576:0:13022:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a8ab724cd40) has no exports 00000020:00080000:3.0:1788360972.965600:0:13022:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a8ab724cd40) has no exports 00010000:00010000:0.0:1788360972.965726:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788360972.965735:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360972.965744:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586b200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788360972.965749:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360972.965758:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788360972.965767:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360972.965773:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788360972.965776:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788360972.965785:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788360972.965798:0:5785:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a83563800 00010000:00010000:0.0:1788360972.965801:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360972.965809:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586b200/0xf6a94c97d6610280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6610287 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360972.965823:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788360972.965827:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360972.965833:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fc00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788360972.965835:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360972.965842:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788360972.965848:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788360972.965854:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788360972.965857:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788360972.965859:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788360972.965863:0:5785:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a83563800 00010000:00010000:0.0:1788360972.965866:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360972.965874:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d66104a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d66104b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788360972.965894:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360972.965896:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788360972.965898:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360972.966071:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788360972.967338:0:13022:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a83458ae0 - data ffff9a8aa9ac2798/ffff9a8ab7472c00 00000020:01000000:3.0:1788360972.967452:0:13022:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a8670c300 - data ffff9a8aa9ac0ca8/ffff9a8985357c00 00100000:10000000:3.0:1788360972.986519:0:13022:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788360973.015967:0:13022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6610073 00000020:00000080:3.0:1788360973.015980:0:13022:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fbe800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788360973.015995:0:13022:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a86b49000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788360973.015998:0:13022:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a86b49000 2 00000020:01000004:3.0:1788360973.016001:0:13022:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8a86b49000 from lustre-OST0000 00000020:00000080:3.0:1788360973.016026:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788360973.017180:0:13022:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788360973.017187:0:13022:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fbf800/lustre-OST0000_UUID 00000020:00000080:3.0:1788360973.017191:0:13022:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fbf800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788360973.017215:0:13022:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788360973.017271:0:13022:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788360973.017277:0:13022:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788360973.017281:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788360973.017287:0:13022:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788360973.017294:0:13022:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a8abc7b0800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788360973.017301:0:13022:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9a8985368000) has exports, disconnecting them 00000020:00080000:3.0:1788360973.017306:0:13022:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a8abc7b0800), last request at 1788360795 00000020:00000080:3.0:1788360973.017311:0:13022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661009d 00000020:00080000:3.0:1788360973.017328:0:13022:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8abc7b0800): rc 0 00000020:00000080:3.0:1788360973.017332:0:13022:0:(genops.c:906:class_export_put()) final put ffff9a8abc7b0800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788360973.019332:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fbe800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788360973.019357:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abc7b0800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788360973.020329:0:13022:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788360973.020336:0:13022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788360973.020341:0:13022:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788360973.020347:0:13022:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788360973.020497:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788360973.020506:0:13022:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788360973.020512:0:13022:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a86b49000 1 00000020:00000080:1.0:1788360973.020531:0:13022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661002d 00000020:00000080:1.0:1788360973.020562:0:13022:0:(genops.c:906:class_export_put()) final put ffff9a8a8675e000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788360973.020568:0:13022:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788360973.020588:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788360973.020592:0:13022:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788360973.020595:0:13022:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9a8a84f10000) has no exports 00000020:00000080:3.0:1788360973.021600:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a86758000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788360973.021609:0:8:0:(genops.c:906:class_export_put()) final put ffff9a8abc7b7000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788360973.021612:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abc7b7000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788360973.021619:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788360973.021670:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8675e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:00010000:3.0:1788360973.024274:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788360973.049368:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788360973.049384:0:13022:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788360973.049642:0:13022:0:(genops.c:906:class_export_put()) final put ffff9a8a86b48000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788360973.049648:0:13022:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a86b48000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788360973.049661:0:13022:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788360973.049809:0:13022:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8a86b4e800 00000020:02000400:3.0:1788360973.050343:0:13022:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788360974.048375:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360975.081643:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788360975.757782:0:13178:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788360975.779357:0:13178:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788360975.779440:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360975.779454:0:13178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360975.779460:0:13178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360975.779466:0:13178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360975.779491:0:13178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788360975.779496:0:13178:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788360975.779520:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788360975.779542:0:13178:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a84854380 x1875232144043392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360977 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788360975.779620:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788360975.779628:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360975.779652:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788360975.779655:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360975.779664:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360975.779671:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360975.779675:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788360975.779678:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788360975.779680:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788360975.779691:0:5786:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a83563800 00010000:00010000:3.0:1788360975.779694:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360975.779700:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e600/0xf6a94c97d6610256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d661025d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360975.779710:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360975.779712:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360975.779714:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788360975.780164:0:13178:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a90b2e680 x1875232144043904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360982 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360975.780182:0:13178:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ac0876d80 x1875232144044032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360983 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360975.780201:0:13178:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ac0875f80 x1875232144044160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788360988 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788360975.780220:0:13178:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788360975.780226:0:13178:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788360975.780249:0:13178:0:(import.c:65:import_set_state_nolock()) ffff9a8ab76dc000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788360975.780327:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144044160:0@lo:400:kworker.0 00000100:00100000:2.0:1788360975.780337:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144044032:0@lo:400:kworker.0 00000100:00100000:2.0:1788360975.780369:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144044416:0@lo:39:umount.0 00000400:00000100:2.0:1788360975.780412:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144044416 offset 0 length 224: 4 00000100:00100000:3.0:1788360975.780519:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144043904:0@lo:400:kworker.0 00000100:00100000:0.0:1788360975.782344:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144043392:0@lo:400:kworker.0 00010000:00010000:3.0:1788360976.099946:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360977.122557:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788360978.081120:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788360978.081131:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788360978.144600:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360979.168988:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360980.192546:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360981.219330:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360982.240556:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788360983.200972:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788360983.200980:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788360983.264790:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360984.291202:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360985.318146:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788360986.016335:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788360975/real 1788360975] req@ffff9a8ac0874000 x1875232144044416/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788360985 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788360986.016377:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8ac0874000 x1875232144044416/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788360985 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788360986.016401:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ab76dc000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788360986.016479:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144044416:0@lo:39:umount.0 00000100:00080000:1.0:1788360986.017061:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788360986.017067:0:13178:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788360986.017072:0:13178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788360986.018360:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360986.018372:0:13178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360986.018377:0:13178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360986.018381:0:13178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360986.018404:0:13178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788360986.018412:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360986.018417:0:13178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360986.018422:0:13178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360986.018428:0:13178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788360986.018473:0:13178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788360986.018479:0:13178:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788360986.018502:0:13178:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788360986.018506:0:13178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788360986.018511:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1788360986.018516:0:11019:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:1.0:1788360986.018517:0:13178:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788360986.018525:0:13178:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a8a84f13380) has no exports 00010000:00010000:2.0:1788360986.018528:0:11019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360986.018538:0:11019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a813ca000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360986.018542:0:11019:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360986.018551:0:11019:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360986.018558:0:11019:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360986.018564:0:11019:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788360986.018566:0:11019:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788360986.018569:0:11019:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788360986.018584:0:11019:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a83563800 00010000:00010000:2.0:1788360986.018587:0:11019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360986.018594:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a813ca000/0xf6a94c97d6610264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d661026b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360986.018609:0:11019:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788360986.018612:0:11019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360986.018618:0:11019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ae00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788360986.018621:0:11019:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360986.018637:0:11019:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788360986.018644:0:11019:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788360986.018649:0:11019:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00080000:1.0:1788360986.018651:0:13178:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a8a84f13380) has no exports 10000000:01000000:2.0:1788360986.018652:0:11019:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788360986.018656:0:11019:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788360986.018665:0:11019:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a83563800 00010000:00010000:2.0:1788360986.018670:0:11019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360986.018681:0:11019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6610494 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d661049b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788360986.018729:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360986.018732:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788360986.018734:0:11019:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788360986.020689:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788360986.020834:0:13178:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a8670d660 - data ffff9a8aa9be5e58/ffff9a8a90bed400 00000020:01000000:1.0:1788360986.021058:0:13178:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a83f30240 - data ffff9a8aa98a4948/ffff9a898109c800 00100000:10000000:1.0:1788360986.035238:0:13178:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788360986.061524:0:13178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661014c 00000020:00000080:3.0:1788360986.061534:0:13178:0:(genops.c:906:class_export_put()) final put ffff9a8ab74b2000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788360986.061556:0:13178:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a898534c800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788360986.061560:0:13178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a898534c800 2 00000020:01000004:3.0:1788360986.061563:0:13178:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a898534c800 from lustre-OST0001 00000020:00000080:3.0:1788360986.061584:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788360986.061593:0:13178:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788360986.061596:0:13178:0:(genops.c:906:class_export_put()) final put ffff9a8abccc2800/lustre-OST0001_UUID 00000020:00000080:3.0:1788360986.061599:0:13178:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abccc2800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788360986.061605:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788360986.061897:0:13178:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d9fa3464-d771-4fa1-895d-6f4c1383568d->MGS 00010000:00010000:3.0:1788360986.061911:0:13178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a80030800/0xf6a94c97d6610050 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6610057 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360986.061923:0:13178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a80030800/0xf6a94c97d6610050 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6610057 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360986.061929:0:13178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788360986.061931:0:13178:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788360986.061934:0:13178:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788360986.061946:0:13178:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a83563800 00010000:00010000:3.0:1788360986.061950:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a80030800/0xf6a94c97d6610050 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6610057 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788360986.061964:0:13178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586b000/0xf6a94c97d66102aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66102b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788360986.061970:0:13178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b000/0xf6a94c97d66102aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66102b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788360986.061987:0:13178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788360986.061989:0:13178:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788360986.061991:0:13178:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788360986.062000:0:13178:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a83563800 00010000:00010000:3.0:1788360986.062003:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586b000/0xf6a94c97d66102aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d66102b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788360986.062020:0:13178:0:(import.c:65:import_set_state_nolock()) ffff9a8a83563800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788360986.062024:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788360986.062026:0:13178:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788360986.062028:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788360986.062032:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788360986.062042:0:13178:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ac0877480 x1875232144044288/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788360987 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788360986.062068:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788360986.062071:0:13178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:1.0:1788360986.062239:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d9fa3464-d771-4fa1-895d-6f4c1383568d:3310:1875232144044288:0@lo:250:kworker.0 00000020:00000080:0.0:1788360986.062319:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab74b2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:3.0:1788360986.062456:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788360986.062473:0:13178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d660ff3f 00000020:00000080:3.0:1788360986.062478:0:13178:0:(genops.c:906:class_export_put()) final put ffff9a8a83561800/d9fa3464-d771-4fa1-895d-6f4c1383568d 00000020:01000000:3.0:1788360986.062493:0:13178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.160@tcp (flags='') 00000020:00000080:3.0:1788360986.062498:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788360986.062502:0:13178:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.160@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788360986.062506:0:13178:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9a8a85713380) has no exports 10000000:01000000:1.0:1788360986.062560:0:5794:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1788360986.062636:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83561800/d9fa3464-d771-4fa1-895d-6f4c1383568d for MGC192.168.203.160@tcp 10000000:01000000:3.0:1788360986.062668:0:13178:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.160@tcp: client import never connected 00000100:00080000:3.0:1788360986.062671:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788360986.062673:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788360986.062684:0:13178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788360986.062686:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788360986.062834:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83563800 for MGC192.168.203.160@tcp 00000020:00000080:3.0:1788360986.062866:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788360986.062872:0:13178:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.160@tcp (uuid d9fa3464-d771-4fa1-895d-6f4c1383568d) 00000020:00000080:3.0:1788360986.062875:0:13178:0:(genops.c:906:class_export_put()) final put ffff9a8a83566000/d9fa3464-d771-4fa1-895d-6f4c1383568d 00000020:00000080:3.0:1788360986.062885:0:13178:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83566000/d9fa3464-d771-4fa1-895d-6f4c1383568d for MGC192.168.203.160@tcp 00000020:01000000:3.0:1788360986.062889:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.160@tcp (d9fa3464-d771-4fa1-895d-6f4c1383568d) 00000020:01000000:0.0:1788360986.063528:0:13178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788360986.063533:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788360986.063538:0:13178:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788360986.063543:0:13178:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a89852f5000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788360986.063549:0:13178:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9a8a84f14d40) has exports, disconnecting them 00000020:00080000:0.0:1788360986.063553:0:13178:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a89852f5000), last request at 1788360808 00000020:00000080:0.0:1788360986.063557:0:13178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6610176 00000020:00080000:0.0:1788360986.063581:0:13178:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a89852f5000): rc 0 00000020:00000080:0.0:1788360986.063585:0:13178:0:(genops.c:906:class_export_put()) final put ffff9a89852f5000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788360986.067487:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89852f5000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788360986.084254:0:13178:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788360986.084265:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788360986.084270:0:13178:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788360986.084276:0:13178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788360986.084306:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ab76dc000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788360986.084447:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788360986.084622:0:11019:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788360986.084840:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788360986.084979:0:11018:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9a8ac0a6d800:11018] 2 exiting: rc = 0 00000100:00100000:3.0:1788360986.085036:0:5781:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a8a86ae5600:5781] 1 exiting: rc = 0 00000100:00100000:3.0:1788360986.086308:0:5780:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a8a87830e00:5780] 0 exiting: rc = 1 00000100:00100000:1.0:1788360986.089132:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.089652:0:7487:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a8abcbcdc00:7487] 3 exiting: rc = 0 00000100:00100000:2.0:1788360986.089753:0:5783:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a8a857af000:5783] 1 exiting: rc = 0 00000100:00100000:2.0:1788360986.089834:0:5784:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a8a90b85a00:5784] 2 exiting: rc = 0 00000100:00100000:3.0:1788360986.089942:0:8303:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9a8a8925a200:8303] 4 exiting: rc = 0 00000100:00100000:3.0:1788360986.090230:0:5782:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a8a857ae400:5782] 0 exiting: rc = 1 00000100:00100000:1.0:1788360986.091485:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091494:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091500:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091506:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091511:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091517:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091523:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091542:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091548:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091559:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091566:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091572:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091579:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091586:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091594:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091601:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091612:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091619:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091623:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091627:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091632:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091636:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091641:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091651:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091657:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091662:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091669:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091675:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091680:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091686:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091691:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091696:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091701:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091707:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091712:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091717:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091722:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091727:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091732:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091737:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091743:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091747:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091760:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091765:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091770:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091775:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091781:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091786:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091793:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091798:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091803:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091808:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091819:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091825:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091830:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091834:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091842:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091848:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091852:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091857:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091862:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091867:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091872:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.091876:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788360986.092779:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788360986.092790:0:13178:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788360986.092796:0:13178:0:(genops.c:906:class_export_put()) final put ffff9a8ab74b6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788360986.092802:0:13178:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab74b6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788360986.092812:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788360986.092859:0:13178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a898534c800 1 00000020:00000080:1.0:1788360986.092867:0:13178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661011b 00000020:00000080:1.0:1788360986.092874:0:13178:0:(genops.c:906:class_export_put()) final put ffff9a8a8a583000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788360986.092896:0:13178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788360986.092901:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788360986.092907:0:13178:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788360986.092911:0:13178:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9a8ab72499c0) has no exports 00000020:00000080:3.0:1788360986.093034:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a583000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788360986.122637:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788360986.122653:0:13178:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788360986.122659:0:13178:0:(genops.c:906:class_export_put()) final put ffff9a898534e800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788360986.122664:0:13178:0:(genops.c:865:class_export_destroy()) destroying export ffff9a898534e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788360986.122675:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788360986.122878:0:13178:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a898534a000 00000020:01000000:0.0:1788360986.122901:0:13178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788360986.122906:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788360986.122910:0:13178:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788360986.122914:0:13178:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9a8ab724b380) has no exports 00000020:00000080:0.0:1788360986.122941:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788360986.122947:0:13178:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788360986.122949:0:13178:0:(genops.c:906:class_export_put()) final put ffff9a8a86759800/OSS_uuid 00000020:00000080:0.0:1788360986.122951:0:13178:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a86759800/OSS_uuid for OSS 00000020:01000000:0.0:1788360986.122956:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788360986.123061:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a8a85286600:6593] 1 exiting: rc = 0 00000100:00080000:1.0:1788360986.123136:0:5793:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788360986.123190:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a8a85646c00:6592] 0 exiting: rc = 1 00000100:00100000:1.0:1788360986.123270:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a8a84ee6c00:6594] 2 exiting: rc = 0 00000100:00100000:1.0:1788360986.123316:0:9606:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a8984b8c800:9606] 3 exiting: rc = 0 00000100:00100000:0.0:1788360986.123847:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123855:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123861:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123868:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123874:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123878:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123884:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123889:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123894:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123900:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123905:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123910:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123915:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123920:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123924:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123929:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123935:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123941:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123947:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123952:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123957:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123962:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123967:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123984:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123989:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.123995:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.124000:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.124005:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.124010:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.124015:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.124021:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.124026:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125865:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125873:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125937:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125947:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125955:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125961:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125966:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125972:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125977:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125983:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125988:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.125996:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126001:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126007:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126013:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126018:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126023:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126029:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126034:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126040:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126046:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126051:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126056:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126061:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126069:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126077:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126115:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126122:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126128:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126134:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126140:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.126147:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128029:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a8a8839c000:6596] 0 exiting: rc = 1 00000100:00100000:1.0:1788360986.128146:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a8a90bd1200:6597] 1 exiting: rc = 0 00000100:00100000:0.0:1788360986.128546:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128554:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128560:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128565:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128569:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128574:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128579:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128584:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128589:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128594:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128600:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128605:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128610:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128615:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128619:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128625:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128629:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128635:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128639:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128644:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128648:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128653:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128657:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128661:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128666:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128670:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128689:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128697:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128719:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128842:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128852:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128857:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128863:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128869:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128874:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128880:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128885:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128890:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128895:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128900:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128905:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128911:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128916:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128921:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128926:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128933:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128938:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128943:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128949:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128954:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128960:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128967:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128973:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128978:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128984:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128989:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128994:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.128999:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.129004:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.129009:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.129015:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.129020:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.129025:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.129039:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.134009:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a8a85753200:6598] 0 exiting: rc = 1 00000100:00100000:2.0:1788360986.135473:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a8a85e99e00:6600] 2 exiting: rc = 0 00000100:00100000:3.0:1788360986.140805:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a8a85753e00:6599] 1 exiting: rc = 0 00000100:00100000:1.0:1788360986.141619:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141628:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141632:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141637:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141642:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141648:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141655:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141660:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141665:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141670:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141675:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141681:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141689:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141695:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141700:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141706:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141711:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141717:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141732:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141739:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141745:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141751:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141756:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141762:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141784:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141792:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141798:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141805:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141810:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141829:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141835:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141840:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141845:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141853:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141858:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141864:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141869:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141875:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141881:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141887:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141892:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141897:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141902:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141908:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141913:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141919:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141924:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141930:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141948:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141954:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141959:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141965:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141970:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141975:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141980:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141986:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141991:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.141996:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.142002:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.142008:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.142014:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.142020:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.142025:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.142031:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.150145:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a8a878ca400:6601] 0 exiting: rc = 1 00000100:00100000:2.0:1788360986.151497:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a8a878cbe00:6602] 1 exiting: rc = 0 00000100:00100000:1.0:1788360986.151736:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151745:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151752:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151759:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151764:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151770:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151776:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151782:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151787:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151792:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151797:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151803:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151809:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151815:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151825:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151832:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151839:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151844:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151848:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151854:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151859:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151864:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151874:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151879:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151884:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151889:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151894:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151899:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151903:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151908:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151912:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151917:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151945:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151951:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151956:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151979:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151984:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151988:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151992:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.151997:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152002:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152006:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152011:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152016:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152024:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152030:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152034:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152039:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152044:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152049:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152054:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152058:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152064:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152069:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152075:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152080:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152103:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152109:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152113:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152119:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152124:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152128:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152133:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152138:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788360986.152905:0:6604:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a8a90bd0800:6604] 1 exiting: rc = 0 00000100:00100000:0.0:1788360986.154711:0:6603:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a8abc7c3000:6603] 0 exiting: rc = 1 00000100:00100000:0.0:1788360986.164781:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165569:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165861:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165870:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165886:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165893:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165901:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165907:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165914:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165921:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165928:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165935:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165940:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.165947:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166653:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166664:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166670:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166677:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166685:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166690:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166707:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166715:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166722:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166730:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166736:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166742:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166768:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166776:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166783:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166790:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166796:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166802:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166823:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166829:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166835:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166842:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166848:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166855:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166878:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166888:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166895:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166901:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166906:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166912:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166917:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166923:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166929:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166935:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166943:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.166950:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167142:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167152:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167158:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167167:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167174:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167181:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167187:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167194:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167254:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167263:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167269:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167275:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167281:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788360986.167296:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788360986.178733:0:13178:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788361000.126743:0:13794:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788361006.537691:0:14208:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788361006.537697:0:14208:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788361006.537810:0:14208:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a89871ae800 00000020:01000004:3.0:1788361006.537829:0:14208:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788361006.537837:0:14208:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788361006.537851:0:14208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a8985368000) 00000020:00000080:3.0:1788361006.537865:0:14208:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788361006.560235:0:14208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788361006.562623:0:14208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788361006.563365:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1788361006.563459:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:2.0:1788361006.563552:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:2.0:1788361006.564385:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1788361006.564490:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1788361006.564730:0:14208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788361006.564806:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:2.0:1788361006.565200:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:2.0:1788361006.566498:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 660: rc = 0 00100000:10000000:2.0:1788361006.566594:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 660: rc = 0 00100000:10000000:2.0:1788361006.567352:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 790: rc = 0 00100000:10000000:2.0:1788361006.567680:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361006.568203:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 790: rc = 0 00100000:10000000:2.0:1788361006.568449:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361006.568687:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361006.569082:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 790: rc = 0 00100000:10000000:2.0:1788361006.569378:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 790: rc = 0 00100000:10000000:2.0:1788361006.569686:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361006.570064:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361006.570419:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 790: rc = 0 00100000:10000000:2.0:1788361006.570685:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361006.571151:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 790: rc = 0 00100000:10000000:2.0:1788361006.571567:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 311: rc = 0 00100000:10000000:2.0:1788361006.572181:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 311: rc = 0 00100000:10000000:2.0:1788361006.572456:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 311: rc = 0 00100000:10000000:2.0:1788361006.572707:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 311: rc = 0 00100000:10000000:2.0:1788361006.573154:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 311: rc = 0 00100000:10000000:2.0:1788361006.573424:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 311: rc = 0 00100000:10000000:2.0:1788361006.573676:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 311: rc = 0 00100000:10000000:2.0:1788361006.574054:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 311: rc = 0 00100000:10000000:2.0:1788361006.574429:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 311: rc = 0 00100000:10000000:2.0:1788361006.574680:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 311: rc = 0 00100000:10000000:2.0:1788361006.575178:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 311: rc = 0 00100000:10000000:2.0:1788361006.575427:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 311: rc = 0 00100000:10000000:2.0:1788361006.576554:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 311: rc = 0 00100000:10000000:2.0:1788361006.576813:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 311: rc = 0 00100000:10000000:2.0:1788361006.577215:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 311: rc = 0 00100000:10000000:2.0:1788361006.578159:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 311: rc = 0 00100000:10000000:2.0:1788361006.582357:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 311: rc = 0 00100000:10000000:2.0:1788361006.582982:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 311: rc = 0 00100000:10000000:2.0:1788361006.583272:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 311: rc = 0 00100000:10000000:2.0:1788361006.583534:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 311: rc = 0 00100000:10000000:2.0:1788361006.585076:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 311: rc = 0 00100000:10000000:2.0:1788361006.585394:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 311: rc = 0 00100000:10000000:2.0:1788361006.585663:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 311: rc = 0 00100000:10000000:2.0:1788361006.586460:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 311: rc = 0 00100000:10000000:2.0:1788361006.586718:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 311: rc = 0 00100000:10000000:2.0:1788361006.589603:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 311: rc = 0 00100000:10000000:2.0:1788361006.589968:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 311: rc = 0 00100000:10000000:2.0:1788361006.590241:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 311: rc = 0 00100000:10000000:2.0:1788361006.590504:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 311: rc = 0 00100000:10000000:2.0:1788361006.590744:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 311: rc = 0 00100000:10000000:2.0:1788361006.590984:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 311: rc = 0 00100000:10000000:2.0:1788361006.591246:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 311: rc = 0 00100000:10000000:2.0:1788361006.591599:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 392: rc = 0 00100000:10000000:2.0:1788361006.592080:0:14208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788361006.593277:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 664: rc = 0 00100000:10000000:2.0:1788361006.593512:0:14208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788361006.593580:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 664: rc = 0 00100000:10000000:2.0:1788361006.593819:0:14208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788361006.594183:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 664: rc = 0 00100000:10000000:2.0:1788361006.594551:0:14208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788361006.594621:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 661: rc = 0 00100000:10000000:3.0:1788361006.597384:0:14208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788361006.597478:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 661: rc = 0 00100000:10000000:3.0:1788361006.598068:0:14208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788361006.598182:0:14208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 661: rc = 0 00000020:00000080:3.0:1788361006.598442:0:14208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788361006.598450:0:14208:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788361006.598459:0:14208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d6611240 00000020:01000004:3.0:1788361006.598466:0:14208:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788361006.598471:0:14208:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788361006.598475:0:14208:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a89871ae800 from MGS 00000020:01000004:3.0:1788361006.598478:0:14208:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788361006.598492:0:14208:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a898536b380) 00000020:00000080:3.0:1788361006.598502:0:14208:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788361006.598552:0:14208:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a89871ae800 from MGS, refs=2 00080000:01000000:3.0:1788361006.598557:0:14208:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788361006.598563:0:14208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d661124e 00000100:00100000:3.0:1788361006.598651:0:14208:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788361006.598762:0:14208:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788361006.598767:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788361006.599558:0:14208:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788361006.599566:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788361006.600506:0:14208:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361006.600649:0:14208:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788361006.600654:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788361006.601522:0:14208:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788361006.601529:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788361006.602264:0:14208:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788361006.602272:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788361006.603253:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361006.603257:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361006.603266:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361006.603537:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361006.603539:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361006.603541:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361006.604448:0:14208:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788361006.610442:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788361006.619387:0:14208:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788361006.619409:0:14208:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788361006.619412:0:14208:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788361006.623739:0:14217:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788361006.624554:0:14208:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788361006.624663:0:14208:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361006.625468:0:14208:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788361006.625762:0:14208:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361006.626304:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788361006.626310:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788361006.634060:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788361006.634077:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788361006.637575:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788361006.637592:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788361006.640628:0:14208:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788361006.640652:0:14208:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.160@tcp' 00000020:01000004:3.0:1788361006.640655:0:14208:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788361006.640691:0:14208:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.160@tcp (typ=mgc) 00000020:00000080:3.0:1788361006.640704:0:14208:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.160@tcp (ffff9a898536cd40) 00000020:00000080:3.0:1788361006.640722:0:14208:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788361006.640806:0:14208:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a89871ad000@MGC192.168.203.160@tcp: add connection 192.168.203.160@tcp at head 00000100:00080000:2.0:1788361006.641051:0:14222:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1788361006.641477:0:14208:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.160@tcp-0 is initialized 00000040:01000000:3.0:1788361006.641484:0:14208:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788361006.642459:0:14223:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788361006.642574:0:14208:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.160@tcp (uuid 7b97d369-4bf1-43ee-a977-45b88f10e003) 00000020:00000080:3.0:1788361006.642599:0:14208:0:(genops.c:1406:class_connect()) connect: client 7b97d369-4bf1-43ee-a977-45b88f10e003, cookie 0xf6a94c97d661125c 00000100:00080000:3.0:1788361006.642612:0:14208:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361006.642619:0:14208:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a89871ad000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361006.642654:0:14208:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0a50e00 x1875232144044544/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361006.642724:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b97d369-4bf1-43ee-a977-45b88f10e003:3310:1875232144044544:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788361006.642791:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361006.643265:0:14208:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7b97d369-4bf1-43ee-a977-45b88f10e003->MGS 00000020:01000004:3.0:1788361006.643291:0:14208:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788361006.643297:0:14208:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788361006.643311:0:14208:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a89853699c0) 00000020:00000080:3.0:1788361006.643333:0:14208:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788361006.647248:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144044544 00000100:00100000:0.0:1788361006.647265:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144044544 00000100:00100000:0.0:1788361006.647327:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361006.647336:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1875232144044544:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788361006.647366:0:14218:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 7b97d369-4bf1-43ee-a977-45b88f10e003@0@lo t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:0.0:1788361006.647400:0:14218:0:(genops.c:1406:class_connect()) connect: client 7b97d369-4bf1-43ee-a977-45b88f10e003, cookie 0xf6a94c97d661126a 00000100:00080000:0.0:1788361006.647543:0:14218:0:(import.c:65:import_set_state_nolock()) ffff9a8a83375800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361006.647637:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+5:3310:x1875232144044544:12345-0@lo:250:mount.lustre.0 Request processed in 299us (4844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361006.647645:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361006.647771:0:3310:0:(client.c:3115:ptlrpc_free_committed()) MGC192.168.203.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788361006.647779:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.160@tcp: connect to target with instance 0 00000100:00080000:2.0:1788361006.647786:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788361006.647792:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788361006.647796:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89871ad000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788361006.647798:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788361006.647811:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788361006.647816:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b97d369-4bf1-43ee-a977-45b88f10e003:3310:1875232144044544:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788361006.653654:0:14208:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361006.653866:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788361006.653988:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788361006.656534:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788361006.656546:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788361006.659773:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788361006.659798:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788361006.660930:0:14208:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361006.663232:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788361006.663262:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788361006.666360:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788361006.666377:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788361006.716890:0:14208:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361006.718367:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788361006.718375:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788361006.720444:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788361006.720462:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788361006.721026:0:14208:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361006.721200:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788361006.721206:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788361006.721657:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788361006.721664:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788361006.725287:0:14208:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361006.725474:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788361006.725479:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788361006.727308:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788361006.727396:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788361006.730880:0:14208:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361006.731082:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788361006.731340:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788361006.732763:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788361006.732777:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788361006.754392:0:14208:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361006.754576:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788361006.754583:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788361006.755956:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788361006.755969:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788361006.756713:0:14208:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788361006.756722:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788361006.757926:0:14208:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788361006.757959:0:14208:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788361006.757966:0:14208:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788361006.758130:0:14208:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788361006.758166:0:14208:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788361006.758171:0:14208:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788361006.758173:0:14208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361006.758174:0:14208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361006.758175:0:14208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361006.758176:0:14208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361006.758178:0:14208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361006.758179:0:14208:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361006.758180:0:14208:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361006.758182:0:14208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361006.758184:0:14208:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361006.758186:0:14208:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788361006.758189:0:14208:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361006.758190:0:14208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361006.758191:0:14208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361006.758192:0:14208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361006.758193:0:14208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361006.758194:0:14208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361006.758195:0:14208:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361006.758196:0:14208:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361006.758197:0:14208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361006.758198:0:14208:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361006.758224:0:14208:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788361006.758244:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144044672:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361006.758311:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361006.758375:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa0acda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.758616:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144044672 00000100:00100000:3.0:1788361006.758623:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144044672 00000100:00100000:3.0:1788361006.758679:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361006.758689:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+5:14208:x1875232144044672:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361006.758734:0:14221:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788361006.758737:0:14221:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788361006.758740:0:14221:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788361006.759210:0:14242:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788361006.759670:0:14221:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788361006.768674:0:14243:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788361006.768683:0:14243:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788361006.768686:0:14243:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788361006.768722:0:14243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788361006.769023:0:14221:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788361006.769033:0:14221:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788361006.785479:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+5:14208:x1875232144044672:12345-0@lo:253:mount.lustre.0 Request processed in 26783us (27159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361006.785497:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361006.785676:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144044672:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361006.785692:0:14208:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788361006.785695:0:14208:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361006.785697:0:14208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361006.785699:0:14208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361006.785700:0:14208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361006.785701:0:14208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361006.785702:0:14208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361006.785704:0:14208:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361006.785718:0:14208:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361006.785720:0:14208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361006.785721:0:14208:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788361006.785738:0:14208:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a89871ae800 from lustre-MDT0000 10000000:01000000:0.0:1788361006.785764:0:14208:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788361006.785766:0:14208:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788361006.785771:0:14208:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a898536cd40 10000000:01000000:0.0:1788361006.785775:0:14208:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361006.785782:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a898536cd40 from 1 10000000:01000000:0.0:1788361006.785785:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788361006.785821:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.785832:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.785840:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361006.785860:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144044800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361006.785894:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361006.785928:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361006.786727:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144044800 00000100:00100000:2.0:1788361006.786735:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144044800 00000100:00100000:2.0:1788361006.786777:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361006.786786:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+5:14208:x1875232144044800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361006.786798:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361006.786814:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d6611278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611271 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361006.786837:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d6611278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611271 expref: 6 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361006.786847:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d6611278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611271 expref: 6 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361006.786855:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45000, rc 0) 00000100:00100000:2.0:1788361006.786899:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+6:14208:x1875232144044800:12345-0@lo:101:mount.lustre.0 Request processed in 114us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361006.786905:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361006.787411:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144044800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361006.787427:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.787436:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361006.787494:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144044928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361006.787543:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361006.787565:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361006.787743:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144044928 00000100:00100000:2.0:1788361006.787755:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144044928 00000100:00100000:2.0:1788361006.787793:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361006.787801:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+6:14208:x1875232144044928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361006.788029:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+6:14208:x1875232144044928:12345-0@lo:501:mount.lustre.0 Request processed in 228us (485us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361006.788037:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361006.788182:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144044928:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788361006.788208:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788361006.788218:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.788226:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361006.788234:0:14208:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a89871ae800 10000000:01000000:0.0:1788361006.788239:0:14208:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788361006.788243:0:14208:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a89871ae800 10000000:01000000:0.0:1788361006.788246:0:14208:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788361006.788249:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a89871ae800 from 1 10000000:01000000:0.0:1788361006.788251:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788361006.788271:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.788290:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.788299:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361006.788316:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144045056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361006.788354:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361006.788466:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.794829:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144045056 00000100:00100000:3.0:1788361006.795024:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144045056 00000100:00100000:3.0:1788361006.795108:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361006.795118:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+6:14208:x1875232144045056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361006.795134:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361006.795158:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586a800/0xf6a94c97d6611286 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661127f expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361006.795183:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586a800/0xf6a94c97d6611286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661127f expref: 7 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361006.795212:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586a800/0xf6a94c97d6611286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661127f expref: 7 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361006.795221:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586a800, rc 0) 00000100:00100000:3.0:1788361006.796065:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+7:14208:x1875232144045056:12345-0@lo:101:mount.lustre.0 Request processed in 944us (7706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.796074:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361006.796812:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144045056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361006.796844:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.796854:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361006.796871:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788361006.796879:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.796886:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361006.796894:0:14208:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788361006.796899:0:14208:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361006.796904:0:14208:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a89871ae800 10000000:01000000:0.0:1788361006.796907:0:14208:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788361006.796911:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788361006.796913:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788361006.796941:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.796948:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.796956:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361006.796976:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144045184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361006.797024:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361006.797065:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.797106:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144045184 00000100:00100000:3.0:1788361006.797113:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144045184 00000100:00100000:3.0:1788361006.797153:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361006.797160:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+7:14208:x1875232144045184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361006.797172:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361006.797182:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586b000/0xf6a94c97d6611294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661128d expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361006.797199:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586b000/0xf6a94c97d6611294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661128d expref: 8 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361006.797208:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586b000/0xf6a94c97d6611294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661128d expref: 8 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361006.797216:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586b000, rc 0) 00000100:00100000:3.0:1788361006.797419:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+8:14208:x1875232144045184:12345-0@lo:101:mount.lustre.0 Request processed in 259us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.797426:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361006.797513:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144045184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361006.797522:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.798738:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361006.798819:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144045312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361006.798863:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361006.798904:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.798998:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144045312 00000100:00100000:3.0:1788361006.799005:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144045312 00000100:00100000:3.0:1788361006.799103:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361006.799111:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+8:14208:x1875232144045312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361006.799508:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+9:14208:x1875232144045312:12345-0@lo:501:mount.lustre.0 Request processed in 396us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.799517:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361006.799544:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144045312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361006.799582:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0877480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144045440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361006.799625:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361006.799752:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144045440 00000100:00100000:1.0:1788361006.799757:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.799758:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144045440 00000100:00100000:3.0:1788361006.799854:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361006.799861:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+9:14208:x1875232144045440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361006.800149:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+9:14208:x1875232144045440:12345-0@lo:503:mount.lustre.0 Request processed in 288us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.800156:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361006.800316:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0877480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144045440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361006.801801:0:14244:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0877480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14244:1875232144045568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361006.801860:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.801931:0:14244:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361006.804728:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144045568 00000100:00100000:2.0:1788361006.804742:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144045568 00000100:00100000:2.0:1788361006.804794:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361006.804804:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+9:14244:x1875232144045568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361006.805892:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+9:14244:x1875232144045568:12345-0@lo:502:llog_process_th.0 Request processed in 1084us (4026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361006.805904:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361006.809144:0:14244:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0877480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14244:1875232144045568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361006.809193:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361006.809207:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.809209:0:14244:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788361006.809225:0:14244:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788361006.809228:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361006.809242:0:14244:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a8a84f14d40) 00000020:00000080:1.0:1788361006.809262:0:14244:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788361006.809267:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788361006.809349:0:14244:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788361006.809356:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66112a2 00000020:00000080:1.0:1788361006.810844:0:14244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788361006.810854:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361006.810860:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.810862:0:14244:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788361006.810865:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361006.810870:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.810872:0:14244:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788361006.810875:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361006.810887:0:14244:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a8a84f13380) 00000020:00000080:1.0:1788361006.810903:0:14244:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788361006.810907:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788361006.810909:0:14244:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788361006.810911:0:14244:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788361006.810917:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788361006.810966:0:14244:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a89871ae800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788361006.810979:0:14244:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a8a84f10000) 00000020:00000080:1.0:1788361006.810987:0:14244:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788361006.811031:0:14244:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788361006.811037:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66112b7 00000020:00000080:1.0:1788361006.811151:0:14244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788361006.811158:0:14244:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788361006.811162:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf6a94c97d66112be 00080000:01000000:1.0:1788361006.811167:0:14244:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788361006.811170:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66112c5 00010000:00010000:1.0:1788361006.913811:0:14244:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788361006.914228:0:14244:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1788361006.914418:0:14244:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788361006.915294:0:14244:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a8a84f119c0) 00000020:00000080:1.0:1788361006.915311:0:14244:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788361006.915496:0:14244:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788361006.915504:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66112d3 00000020:00000080:1.0:1788361006.916169:0:14244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788361006.921229:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf6a94c97d66112da 00000020:00000080:2.0:1788361006.921676:0:14244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788361006.921687:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361006.921692:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361006.921694:0:14244:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788361006.921698:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361006.921703:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361006.921704:0:14244:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788361006.921708:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788361006.921741:0:14244:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788361006.921754:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361006.921757:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361006.921758:0:14244:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788361006.921760:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788361006.921762:0:14244:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788361006.921764:0:14244:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361006.921765:0:14244:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361006.921766:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788361006.921774:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361006.921776:0:14244:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788361006.921779:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788361006.921782:0:14244:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788361006.921785:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361006.921786:0:14244:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788361006.921789:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788361006.921794:0:14244:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:2.0:1788361006.921816:0:14244:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788361006.921818:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361006.921830:0:14244:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a8ab7248000) 00000020:00000080:2.0:1788361006.921843:0:14244:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788361006.921847:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788361006.922074:0:14244:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788361006.922079:0:14244:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788361006.922117:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66112e8 00010000:00080000:2.0:1788361006.922154:0:14244:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8aae465800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:2.0:1788361006.922364:0:14244:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788361006.923540:0:14244:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788361006.923578:0:14244:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788361006.925975:0:14244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361006.926039:0:14244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788361006.926201:0:14244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788361006.926779:0:14248:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788361006.926785:0:14248:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788361006.927475:0:14244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361006.927487:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788361006.927521:0:14244:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788361006.927547:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66112ef 00000100:00080000:1.0:1788361006.927558:0:14244:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361006.927564:0:14244:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8aae465800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361006.927598:0:14244:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0877480 x1875232144045696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361006.927754:0:14244:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788361006.927831:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361006.927835:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.927837:0:14244:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788361006.927839:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788361006.927842:0:14244:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788361006.927844:0:14244:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361006.927845:0:14244:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361006.927847:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788361006.927849:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.927851:0:14244:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788361006.927854:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788361006.927857:0:14244:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788361006.927861:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.927871:0:14244:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788361006.927875:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788361006.927879:0:14244:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:1.0:1788361006.927902:0:14244:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788361006.927904:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361006.927914:0:14244:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a8a85713380) 00000020:00000080:1.0:1788361006.927926:0:14244:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788361006.927930:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788361006.927983:0:14244:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788361006.927988:0:14244:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788361006.927994:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66112fd 00010000:00080000:1.0:1788361006.928023:0:14244:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8abf244000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1788361006.928243:0:14244:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788361006.928575:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144045696:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788361006.928695:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144045696 offset 0 length 520: 4 00000040:01000000:1.0:1788361006.929219:0:14244:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788361006.929243:0:14244:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788361006.930991:0:14244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361006.931108:0:14244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788361006.931181:0:14244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788361006.931977:0:14250:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788361006.931982:0:14250:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788361006.932788:0:14244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361006.932801:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788361006.932830:0:14244:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788361006.932848:0:14244:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6611304 00000100:00080000:1.0:1788361006.932858:0:14244:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361006.932863:0:14244:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8abf244000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361006.932906:0:14244:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0877800 x1875232144045824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361006.932936:0:14244:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788361006.932995:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361006.932999:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.933001:0:14244:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788361006.933010:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361006.933014:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.933015:0:14244:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788361006.933018:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788361006.933019:0:14244:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788361006.933021:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361006.933024:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.933025:0:14244:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788361006.933027:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361006.933029:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.933031:0:14244:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788361006.933034:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788361006.933064:0:14244:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14244:1875232144045952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361006.933177:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.933211:0:14244:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361006.933531:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144045824:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788361006.933558:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144045824 offset 0 length 520: 4 00000100:00100000:3.0:1788361006.935836:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144045952 00000100:00100000:3.0:1788361006.935851:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144045952 00000100:00100000:3.0:1788361006.935913:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361006.935923:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+9:14244:x1875232144045952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361006.936484:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+9:14244:x1875232144045952:12345-0@lo:502:llog_process_th.0 Request processed in 562us (3305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.936493:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788361006.936772:0:14244:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14244:1875232144045952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361006.936807:0:14244:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361006.936815:0:14244:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.936817:0:14244:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788361006.936821:0:14244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788361006.937066:0:14208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788361006.937107:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788361006.937123:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.937134:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361006.937141:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a89871ae800 from 1 10000000:01000000:0.0:1788361006.937144:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361006.937178:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.937187:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.937196:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361006.937222:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361006.937344:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361006.937380:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361006.937492:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144046080 00000100:00100000:2.0:1788361006.937504:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144046080 00000100:00100000:2.0:1788361006.937539:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788361006.937546:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+9:14208:x1875232144046080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361006.937558:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361006.937570:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b44200/0xf6a94c97d6611312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661130b expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361006.937592:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b44200/0xf6a94c97d6611312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661130b expref: 10 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361006.937603:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8b44200/0xf6a94c97d6611312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661130b expref: 10 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361006.937611:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44200, rc 0) 00000100:00100000:2.0:1788361006.937666:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+10:14208:x1875232144046080:12345-0@lo:101:mount.lustre.0 Request processed in 120us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361006.937674:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361006.942155:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361006.942183:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.942195:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361006.944756:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046208:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788361006.944835:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.944878:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.945358:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144046208 00000100:00100000:3.0:1788361006.945366:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144046208 00000100:00100000:3.0:1788361006.945418:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361006.945427:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+10:14208:x1875232144046208:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788361006.945447:0:14218:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788361006.945452:0:14218:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788361006.946425:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+10:14208:x1875232144046208:12345-0@lo:256:mount.lustre.0 Request processed in 995us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.946448:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788361006.947072:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046208:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788361006.948129:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361006.948153:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361006.948165:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361006.948209:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a89871ae800 from 1 10000000:01000000:1.0:1788361006.948213:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361006.948396:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361006.948405:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361006.948415:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361006.948439:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361006.948493:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.948536:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361006.948604:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144046336 00000100:00100000:0.0:1788361006.948611:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144046336 00000100:00100000:0.0:1788361006.948668:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361006.948676:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+10:14208:x1875232144046336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361006.948688:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361006.948703:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8c42c00/0xf6a94c97d6611320 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611319 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.948730:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8c42c00/0xf6a94c97d6611320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611319 expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.948741:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8c42c00/0xf6a94c97d6611320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611319 expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361006.948749:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42c00, rc 0) 00000100:00100000:0.0:1788361006.948795:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14208:x1875232144046336:12345-0@lo:101:mount.lustre.0 Request processed in 120us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361006.948811:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361006.948983:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361006.948997:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361006.949006:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361006.949061:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361006.949130:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.949175:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.949193:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144046464 00000100:00100000:3.0:1788361006.949199:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144046464 00000100:00100000:3.0:1788361006.949220:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788361006.949236:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14208:x1875232144046464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361006.949631:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14208:x1875232144046464:12345-0@lo:501:mount.lustre.0 Request processed in 403us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.949639:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361006.949719:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361006.949747:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361006.949787:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.949864:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361006.952466:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144046592 00000100:00100000:2.0:1788361006.952480:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144046592 00000100:00100000:2.0:1788361006.952579:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788361006.952598:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14208:x1875232144046592:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361006.952838:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14208:x1875232144046592:12345-0@lo:503:mount.lustre.0 Request processed in 242us (3050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361006.952846:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361006.952937:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361006.957195:0:14252:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14252:1875232144046720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361006.957362:0:14252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361006.957447:0:14252:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.957578:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144046720 00000100:00100000:3.0:1788361006.957595:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144046720 00000100:00100000:3.0:1788361006.957643:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788361006.957652:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14252:x1875232144046720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361006.957913:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14252:x1875232144046720:12345-0@lo:502:llog_process_th.0 Request processed in 262us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.957921:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788361006.957964:0:14252:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14252:1875232144046720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361006.957995:0:14252:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361006.958005:0:14252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.958007:0:14252:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788361006.958014:0:14252:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a89871ae800 00000020:00000080:1.0:1788361006.958017:0:14252:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788361006.958025:0:14252:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361006.958028:0:14252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.958029:0:14252:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788361006.958031:0:14252:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361006.958033:0:14252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.958035:0:14252:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788361006.958038:0:14252:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a89871ae800 00000020:00000080:1.0:1788361006.958039:0:14252:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788361006.958168:0:14252:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361006.958173:0:14252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.958174:0:14252:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788361006.958177:0:14252:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361006.958180:0:14252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.958181:0:14252:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788361006.958185:0:14252:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a89871ae800 00000020:00000080:1.0:1788361006.958187:0:14252:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788361006.958294:0:14252:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14252:1875232144046848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361006.961352:0:14252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.961399:0:14252:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.961405:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144046848 00000100:00100000:3.0:1788361006.961414:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144046848 00000100:00100000:3.0:1788361006.961472:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788361006.961483:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14252:x1875232144046848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361006.961745:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14252:x1875232144046848:12345-0@lo:502:llog_process_th.0 Request processed in 263us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.961753:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361006.961833:0:14252:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14252:1875232144046848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361006.961869:0:14252:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361006.961876:0:14252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361006.961878:0:14252:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788361006.961882:0:14252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788361006.961941:0:14208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788361006.961959:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361006.961982:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361006.961993:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361006.962037:0:14208:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361006.962041:0:14208:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a89871ae800 10000000:01000000:1.0:1788361006.962044:0:14208:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a89871ae800 10000000:01000000:1.0:1788361006.962048:0:14208:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361006.962052:0:14208:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a89871ae800 from 1 10000000:01000000:1.0:1788361006.962055:0:14208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361006.962081:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361006.962122:0:14208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361006.962131:0:14208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361006.962152:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361006.962181:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.962218:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.962223:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144046976 00000100:00100000:3.0:1788361006.962239:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144046976 00000100:00100000:3.0:1788361006.962271:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361006.962278:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14208:x1875232144046976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361006.962296:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361006.962308:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586b600/0xf6a94c97d661132e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611327 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361006.962339:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586b600/0xf6a94c97d661132e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611327 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361006.962350:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586b600/0xf6a94c97d661132e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611327 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361006.962359:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586b600, rc 0) 00000100:00100000:3.0:1788361006.962408:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14208:x1875232144046976:12345-0@lo:101:mount.lustre.0 Request processed in 130us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.962414:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361006.962443:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144046976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361006.962457:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361006.962466:0:14208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361006.962505:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144047104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361006.962527:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.962550:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.962604:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144047104 00000100:00100000:3.0:1788361006.962609:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144047104 00000100:00100000:3.0:1788361006.962631:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361006.962637:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14208:x1875232144047104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361006.962855:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14208:x1875232144047104:12345-0@lo:501:mount.lustre.0 Request processed in 217us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.962862:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361006.962894:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144047104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361006.962924:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144047232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361006.962964:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.962984:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.963032:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144047232 00000100:00100000:3.0:1788361006.963037:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144047232 00000100:00100000:3.0:1788361006.963064:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361006.963071:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14208:x1875232144047232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361006.963654:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14208:x1875232144047232:12345-0@lo:503:mount.lustre.0 Request processed in 582us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.963671:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361006.963766:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144047232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361006.964164:0:14254:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14254:1875232144047360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361006.964204:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361006.964225:0:14254:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.964335:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144047360 00000100:00100000:3.0:1788361006.964341:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144047360 00000100:00100000:3.0:1788361006.964389:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361006.964397:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14254:x1875232144047360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361006.964931:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14254:x1875232144047360:12345-0@lo:502:llog_process_th.0 Request processed in 533us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.964940:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788361006.965033:0:14254:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14254:1875232144047360:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788361006.965118:0:14254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788361006.965131:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a8a85714d40) 00000020:00000080:1.0:1788361006.965151:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788361006.966441:0:14254:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a89871ae800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361006.966448:0:14254:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a89871ae800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788361006.966451:0:14254:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a89871ae800 4 00010000:00080000:1.0:1788361006.966578:0:14254:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a83cfa800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1788361006.970218:0:14254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788361006.970334:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788361006.970371:0:14254:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788361006.970384:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf6a94c97d661133c 00000100:00080000:1.0:1788361006.970395:0:14254:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361006.970401:0:14254:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a8a83cfa800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361006.970437:0:14254:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0875180 x1875232144047488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361006.970771:0:14254:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788361006.971557:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144047488:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361006.971632:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361006.971706:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144047488 00000100:00100000:2.0:1788361006.971714:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144047488 00000100:00100000:2.0:1788361006.971760:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361006.971768:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144047488:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361006.971825:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144047488:12345-0@lo:38:llog_process_th.0 Request processed in 57us (192us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788361006.971832:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361006.971882:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361006.971891:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a83cfa800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361006.971896:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788361006.971900:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144047488:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361006.975573:0:14254:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14254:1875232144047616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361006.975706:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361006.975751:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144047616 00000100:00100000:1.0:1788361006.975755:0:14254:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.975760:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144047616 00000100:00100000:3.0:1788361006.975808:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361006.975817:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14254:x1875232144047616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361006.976754:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14254:x1875232144047616:12345-0@lo:502:llog_process_th.0 Request processed in 934us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361006.976764:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788361006.978480:0:14254:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b97d369-4bf1-43ee-a977-45b88f10e003:14254:1875232144047616:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788361006.978526:0:14254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788361006.978681:0:14208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788361006.978704:0:14208:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361006.978719:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361006.978730:0:14208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788361006.978769:0:14208:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788361006.978771:0:14208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361006.978772:0:14208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361006.978774:0:14208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361006.978779:0:14208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361006.978780:0:14208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361006.978781:0:14208:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361006.978783:0:14208:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361006.978784:0:14208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361006.978785:0:14208:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361006.978789:0:14208:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788361006.978791:0:14208:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361006.978792:0:14208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361006.978793:0:14208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361006.978794:0:14208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361006.978795:0:14208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361006.978796:0:14208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361006.978797:0:14208:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361006.978798:0:14208:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361006.978799:0:14208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361006.978800:0:14208:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361006.978828:0:14208:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788361006.978844:0:14208:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144047744:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361006.978892:0:14208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361006.978921:0:14208:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361006.978945:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144047744 00000100:00100000:3.0:1788361006.979012:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144047744 00000100:00100000:3.0:1788361006.979051:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788361006.979059:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14208:x1875232144047744:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361006.979100:0:14221:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788361006.979111:0:14221:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361007.041454:0:14221:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361007.041466:0:14221:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788361007.043201:0:14242:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361007.043209:0:14242:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361007.043231:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361007.043250:0:14242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8aa8b44200/0xf6a94c97d6611312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661130b expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361007.043258:0:14242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361007.043300:0:14242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8aa8b44200/0xf6a94c97d6611312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661130b expref: 12 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361007.043314:0:14242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8aa8b44200/0xf6a94c97d6611312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661130b expref: 12 pid: 14220 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361007.043338:0:14242:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14242:1875232144047872:0@lo:104: 00000100:00100000:0.0:1788361007.043398:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361007.043453:0:14242:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361007.044456:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144047872 00000100:00100000:3.0:1788361007.045174:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144047872 00000100:00100000:3.0:1788361007.045225:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361007.045234:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+3:14242:x1875232144047872:12345-0@lo:104: 00010000:00010000:3.0:1788361007.045251:0:14209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361007.045360:0:14209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788361007.045366:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+3:14242:x1875232144047872:12345-0@lo:104: Request processed in 134us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361007.045373:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788361007.045491:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361007.045500:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.045507:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361007.045511:0:14215:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.045520:0:14215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361007.045528:0:14215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361007.045534:0:14215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361007.045577:0:14215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.045594:0:14215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361007.045616:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.045629:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42800/0xf6a94c97d661130b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611312 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.045659:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361007.045662:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361007.045664:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361007.045701:0:14242:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14242:1875232144047872:0@lo:104: 00000100:00100000:3.0:1788361007.045704:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b97d369-4bf1-43ee-a977-45b88f10e003:3313:1875232144048000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361007.045724:0:14242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361007.045745:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361007.045867:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144048000 00000100:00100000:2.0:1788361007.045873:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144048000 00010000:00010000:2.0:1788361007.045893:0:14211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8aa8b44200/0xf6a94c97d6611312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661130b expref: 13 pid: 14220 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361007.045922:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361007.045929:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+13:3313:x1875232144048000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361007.045939:0:14211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361007.045946:0:14211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8aa8b44200/0xf6a94c97d6611312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661130b expref: 13 pid: 14220 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.045956:0:14211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8aa8b44200/0xf6a94c97d6611312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661130b expref: 13 pid: 14220 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.045969:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b44200/0xf6a94c97d6611312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661130b expref: 13 pid: 14220 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.045982:0:14211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.045996:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361007.046010:0:14211:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002802561s 00010000:00010000:2.0:1788361007.046015:0:14211:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.046022:0:14211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.046029:0:14211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.046035:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.046040:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361007.046044:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.046052:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.046072:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361007.046081:0:14211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361007.046128:0:14242:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361007.046138:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361007.046146:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d6611343 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361007.046151:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+12:3313:x1875232144048000:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361007.046163:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361007.046199:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b97d369-4bf1-43ee-a977-45b88f10e003:3313:1875232144048000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361007.058216:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14208:x1875232144047744:12345-0@lo:253:mount.lustre.0 Request processed in 79149us (79313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361007.058230:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788361007.058378:0:14208:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14208:1875232144047744:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361007.058395:0:14208:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788361007.058399:0:14208:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361007.058400:0:14208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361007.058402:0:14208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361007.058413:0:14208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361007.058414:0:14208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361007.058415:0:14208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361007.058416:0:14208:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361007.058418:0:14208:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361007.058420:0:14208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361007.058421:0:14208:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788361007.058437:0:14208:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788361007.071302:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361007.071488:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361007.071773:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361007.071928:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361007.072217:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361007.072389:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361007.074262:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361007.074446:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361007.076027:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361007.076398:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361007.079848:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361007.080077:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788361007.127285:0:14208:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788361007.128038:0:14208:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788361007.128186:0:14265:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788361007.128191:0:14265:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788361007.128931:0:14266:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788361007.129040:0:14266:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361007.136880:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788361007.136966:0:14266:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788361007.136971:0:14266:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788361007.138210:0:14208:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788361007.138473:0:14208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788361007.139037:0:14208:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788361007.139045:0:14208:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788361007.139801:0:14208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361007.141295:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788361007.144033:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788361007.144123:0:14208:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788361007.150000:0:14208:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788361007.164243:0:14208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788361007.198166:0:14208:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788361007.198204:0:14208:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa998c181b988 00100000:10000000:2.0:1788361007.198212:0:14208:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788361007.203139:0:14208:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788361007.203157:0:14208:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788361007.203169:0:14208:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788361007.203238:0:14208:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788361007.648352:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361008.032910:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788361008.608155:0:14223:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361008.608164:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a89871ae800 from 6 10000000:01000000:3.0:1788361008.608169:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361008.608222:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361008.608234:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361008.608244:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361008.608269:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144048128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361008.608351:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361008.608415:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85014000 going to sleep for 11 seconds 00000100:00100000:1.0:1788361008.608475:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144048128 00000100:00100000:1.0:1788361008.608488:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144048128 00000100:00100000:1.0:1788361008.608544:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788361008.608554:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14223:x1875232144048128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361008.608571:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361008.608585:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d6611351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661134a expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361008.608608:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d6611351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661134a expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361008.608619:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d6611351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661134a expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361008.608628:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705b600, rc 0) 00000100:00100000:1.0:1788361008.608674:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14223:x1875232144048128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361008.608681:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788361008.608788:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144048128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361008.608803:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361008.608814:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361008.608866:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144048256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788361008.608897:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361008.608919:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361008.609116:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144048256 00000100:00100000:3.0:1788361008.609121:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144048256 00000100:00100000:3.0:1788361008.609169:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361008.609176:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14223:x1875232144048256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361008.609194:0:14221:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788361008.609209:0:14221:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361008.609212:0:14221:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788361008.609329:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14223:x1875232144048256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361008.609337:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361008.609783:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144048256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788361008.609835:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788361008.609847:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361008.609855:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361008.673684:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361009.059784:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788361009.699702:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361010.722156:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361011.131617:0:14509:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788361011.744276:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361012.391491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361012.391498:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788361012.391501:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361012.391504:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788361012.391507:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788361012.391510:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361012.391514:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a8a83cfa800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361012.391528:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a8a83cfa800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361012.391564:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a84856d80 x1875232144048512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361012.391708:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361012.391726:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b97d369-4bf1-43ee-a977-45b88f10e003:3313:1875232144048384:0@lo:400:kworker.0 00000100:00100000:2.0:1788361012.391796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361012.391854:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144048384 00000100:00100000:2.0:1788361012.391861:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144048384 00000100:00100000:2.0:1788361012.391904:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788361012.391913:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+12:3313:x1875232144048384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361012.391960:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+12:3313:x1875232144048384:12345-0@lo:400:kworker.0 Request processed in 48us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361012.391980:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788361012.392033:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b97d369-4bf1-43ee-a977-45b88f10e003:3313:1875232144048384:0@lo:400:kworker.0 00000100:00100000:3.0:1788361012.392871:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144048512:0@lo:38:kworker.0 00000100:00100000:3.0:1788361012.392918:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361012.393027:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144048512 00000100:00100000:0.0:1788361012.393033:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144048512 00000100:00100000:0.0:1788361012.393119:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361012.393126:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144048512:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788361012.393149:0:14228:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:0.0:1788361012.393194:0:14228:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf6a94c97d6611358 00000004:00100000:0.0:1788361012.393209:0:14228:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788361012.393342:0:14228:0:(import.c:65:import_set_state_nolock()) ffff9a8a8337f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361012.393394:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232144048512:12345-0@lo:38:kworker.0 Request processed in 267us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361012.393401:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788361012.393479:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8a84856d80 x1875232144048512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361012.393510:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788361012.393518:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788361012.393523:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361012.393526:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a83cfa800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361012.393532:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144048512:0@lo:38:kworker.0 00010000:00010000:3.0:1788361012.770283:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361013.793387:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361013.804566:0:14659:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff559599b0 20000000:00000080:2.0:1788361013.804586:0:14659:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8a84123c00 uarg=0000000000000000 20000000:01000000:2.0:1788361013.804621:0:14659:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788361013.804629:0:14659:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788361013.804634:0:14659:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788361013.805691:0:14660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788361013.805925:0:14659:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788361013.815940:0:14659:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788361013.816201:0:14659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361013.816219:0:14659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8aa8c42c00/0xf6a94c97d6611320 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611319 expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361013.816228:0:14659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361013.816286:0:14659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8aa8c42c00/0xf6a94c97d6611320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6611319 expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361013.816311:0:14659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8aa8c42c00/0xf6a94c97d6611320 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6611319 expref: 11 pid: 14221 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361013.816325:0:14659:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14659:1875232144048640:0@lo:104: 00000100:00100000:2.0:1788361013.816388:0:14659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361013.816445:0:14659:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83c98540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361013.816516:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144048640 00000100:00100000:0.0:1788361013.816524:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144048640 00000100:00100000:0.0:1788361013.816589:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361013.816598:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+3:14659:x1875232144048640:12345-0@lo:104: 00010000:00010000:0.0:1788361013.816611:0:14210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361013.816659:0:14210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361013.816666:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+3:14659:x1875232144048640:12345-0@lo:104: Request processed in 70us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361013.816673:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788361013.817474:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361013.817482:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.817491:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361013.817495:0:14215:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.817504:0:14215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361013.817511:0:14215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361013.817531:0:14215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788361013.818132:0:14215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818141:0:14215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361013.818162:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818168:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab705a800/0xf6a94c97d6611319 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611320 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818183:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361013.818185:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361013.818187:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361013.818225:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144048768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361013.818280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361013.818356:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144048768 00000100:00100000:1.0:1788361013.818362:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144048768 00010000:00010000:1.0:1788361013.818385:0:14212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8aa8c42c00/0xf6a94c97d6611320 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611319 expref: 12 pid: 14221 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361013.818408:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361013.818416:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+12:3311:x1875232144048768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361013.818427:0:14212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361013.818432:0:14212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8aa8c42c00/0xf6a94c97d6611320 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611319 expref: 12 pid: 14221 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818442:0:14212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8aa8c42c00/0xf6a94c97d6611320 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6611319 expref: 12 pid: 14221 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818467:0:14212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818475:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818490:0:14212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818497:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818504:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818509:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818514:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361013.818518:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818526:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.818534:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361013.819096:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8c42c00/0xf6a94c97d6611320 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6611319 expref: 12 pid: 14221 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361013.819122:0:14659:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14659:1875232144048640:0@lo:104: 00010000:00010000:2.0:1788361013.819140:0:14659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361013.819149:0:14659:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361013.819155:0:14659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.821314:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b45a00/0xf6a94c97d661135f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361013.821351:0:14212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361013.821431:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+11:3311:x1875232144048768:12345-0@lo:103:ldlm_bl.0 Request processed in 3013us (3157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361013.821441:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361013.821494:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144048768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361014.816240:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788361015.138368:0:14223:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788361015.138376:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a89871ae800 from 10 10000000:01000000:1.0:1788361015.138382:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361015.138430:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361015.138441:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361015.138452:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361015.138481:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144048896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361015.138550:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361015.138612:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361015.138767:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144048896 00000100:00100000:0.0:1788361015.138775:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144048896 00000100:00100000:0.0:1788361015.138944:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788361015.138954:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+11:14223:x1875232144048896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361015.138968:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361015.138982:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d661136d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611366 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361015.139004:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d661136d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611366 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361015.139014:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d661136d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611366 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361015.139024:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42200, rc 0) 00000100:00100000:0.0:1788361015.139078:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14223:x1875232144048896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361015.139121:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788361015.147721:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144048896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361015.147751:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361015.147765:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361015.152507:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144049024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361015.152575:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361015.152614:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361015.154938:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144049024 00000100:00100000:1.0:1788361015.154951:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144049024 00000100:00100000:1.0:1788361015.155013:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788361015.155022:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14223:x1875232144049024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361015.155374:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14223:x1875232144049024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (2798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361015.155383:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361015.155670:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144049024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361015.155720:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144049152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361015.155770:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361015.155805:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361015.155941:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144049152 00000100:00100000:1.0:1788361015.155946:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144049152 00000100:00100000:1.0:1788361015.155982:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788361015.155989:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14223:x1875232144049152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361015.156169:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14223:x1875232144049152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361015.156177:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361015.156458:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144049152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361015.157479:0:14728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788361015.157746:0:14223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788361015.157766:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361015.157776:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361015.157788:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361015.844390:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361016.493682:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361006/real 1788361006] req@ffff9a8ac0877800 x1875232144045824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361016 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361016.493714:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8ac0877800 x1875232144045824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361016 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361016.493723:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361006/real 1788361006] req@ffff9a8ac0877480 x1875232144045696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361016 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361016.493733:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8ac0877480 x1875232144045696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361016 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361016.493750:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8abf244000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361016.493776:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788361016.493781:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144045824:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788361016.493787:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8aae465800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361016.493793:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788361016.493795:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144045696:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788361016.502207:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361016.502215:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788361016.502219:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a8aae465800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361016.502226:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:0.0:1788361016.502232:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361016.502239:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8aae465800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361016.502269:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a90b2f100 x1875232144049408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361016.502296:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361016.502300:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788361016.502303:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a8abf244000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361016.502307:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00100000:2.0:1788361016.502309:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788361016.502310:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361016.502317:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8abf244000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361016.502331:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144049280:0@lo:400:kworker.0 00000100:00100000:0.0:1788361016.502333:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a90b2e300 x1875232144049536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361016.502385:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144049408:0@lo:8:kworker.0 00000100:00100000:2.0:1788361016.502406:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:0.0:1788361016.505319:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144049408 offset 0 length 520: 4 00000100:00100000:0.0:1788361016.505377:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144049536:0@lo:8:kworker.0 00000400:00000100:0.0:1788361016.505418:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144049536 offset 0 length 520: 4 00000100:00100000:1.0:1788361016.505961:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361016.505974:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144049664:0@lo:400:kworker.0 00000100:00100000:1.0:1788361016.506019:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361016.506053:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144049280 00000100:00100000:1.0:1788361016.506061:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144049280 00000100:00100000:1.0:1788361016.506123:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788361016.506133:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+12:3311:x1875232144049280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361016.506185:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+12:3311:x1875232144049280:12345-0@lo:400:kworker.0 Request processed in 53us (3780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361016.506205:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788361016.506260:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144049664 00000100:00100000:1.0:1788361016.506271:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144049664 00000100:00100000:1.0:1788361016.506299:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361016.506305:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144049664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361016.506345:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144049664:12345-0@lo:400:kworker.0 Request processed in 39us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361016.506352:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788361016.506392:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8a90b2ed80 x1875232144049664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361016.506406:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144049664:0@lo:400:kworker.0 00000100:00100000:2.0:1788361016.507501:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144049280:0@lo:400:kworker.0 00010000:00010000:0.0:1788361016.864207:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361017.431435:0:14861:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788361017.431442:0:14861:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788361017.431645:0:14861:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8a9efc3000 00000020:01000004:0.0:1788361017.431668:0:14861:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788361017.431680:0:14861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788361017.431697:0:14861:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a8a90bf4d40) 00000020:00000080:0.0:1788361017.431715:0:14861:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788361017.451640:0:14861:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788361017.451946:0:14861:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788361017.452894:0:14861:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788361017.453159:0:14861:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788361017.453376:0:14861:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788361017.453820:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1788361017.453959:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1788361017.454225:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1788361017.455692:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 720: rc = 0 00100000:10000000:2.0:1788361017.455980:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 720: rc = 0 00100000:10000000:2.0:1788361017.456288:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 720: rc = 0 00100000:10000000:2.0:1788361017.456529:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 720: rc = 0 00100000:10000000:2.0:1788361017.456782:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 720: rc = 0 00100000:10000000:2.0:1788361017.457038:0:14861:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 720: rc = 0 00000020:00000080:2.0:1788361017.457785:0:14861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788361017.457796:0:14861:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788361017.457809:0:14861:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d661137b 00000020:01000004:2.0:1788361017.457818:0:14861:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788361017.457839:0:14861:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788361017.457843:0:14861:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788361017.457849:0:14861:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788361017.457853:0:14861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788361017.457863:0:14861:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a8ab724b380) 00000020:00000080:2.0:1788361017.457875:0:14861:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788361017.459464:0:14861:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361017.459636:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788361017.459643:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788361017.464148:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788361017.464165:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788361017.464600:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788361017.464607:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788361017.466023:0:14861:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361017.466213:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788361017.466219:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788361017.466844:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788361017.466852:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788361017.492260:0:14861:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361017.492495:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788361017.492502:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788361017.494614:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788361017.494626:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788361017.497243:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788361017.497267:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788361017.507844:0:14861:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361017.508025:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788361017.508031:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788361017.508889:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788361017.508897:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788361017.545274:0:14861:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361017.545470:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788361017.545476:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788361017.546837:0:14861:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788361017.546848:0:14861:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788361017.547287:0:14861:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788361017.547308:0:14861:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788361017.547320:0:14861:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788361017.560729:0:14861:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788361017.560770:0:14861:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788361017.560775:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788361017.560778:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361017.560779:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361017.560780:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361017.560781:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361017.560783:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361017.560784:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361017.560786:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361017.560792:0:14861:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361017.560796:0:14861:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788361017.560798:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361017.560799:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361017.560800:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361017.560801:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361017.560802:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361017.560803:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361017.560804:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361017.560805:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361017.560806:0:14861:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361017.560831:0:14861:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788361017.560852:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144049792:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788361017.560936:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361017.561057:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361017.563717:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144049792 00000100:00100000:0.0:1788361017.563732:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144049792 00000100:00100000:0.0:1788361017.563782:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361017.563791:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14861:x1875232144049792:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361017.563822:0:14218:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788361017.563826:0:14218:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788361017.563829:0:14218:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788361017.571948:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14861:x1875232144049792:12345-0@lo:253:mount.lustre.0 Request processed in 8147us (11001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361017.571963:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788361017.572067:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144049792:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788361017.572082:0:14861:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788361017.572115:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361017.572116:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361017.572118:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361017.572119:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361017.572120:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361017.572121:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361017.572123:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361017.572125:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361017.572126:0:14861:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788361017.572163:0:14861:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8a9efc3000 from lustre-OST0000 10000000:01000000:1.0:1788361017.572190:0:14861:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788361017.572193:0:14861:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788361017.572200:0:14861:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a898536cd40 local copy 00010000:00010000:1.0:1788361017.572210:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361017.572441:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144049920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361017.572488:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361017.572576:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361017.572807:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144049920 00000100:00100000:2.0:1788361017.572813:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144049920 00000100:00100000:2.0:1788361017.572885:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788361017.572895:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14861:x1875232144049920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361017.573058:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14861:x1875232144049920:12345-0@lo:501:mount.lustre.0 Request processed in 163us (569us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361017.573065:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788361017.573144:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144049920:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788361017.573161:0:14861:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788361017.573327:0:14861:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788361017.573335:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.573345:0:14861:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361017.573364:0:14861:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8a9efc3000 10000000:01000000:3.0:1788361017.573368:0:14861:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788361017.573373:0:14861:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a898536cd40 10000000:01000000:3.0:1788361017.573375:0:14861:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788361017.573378:0:14861:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a898536cd40 from 1 10000000:01000000:3.0:1788361017.573381:0:14861:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788361017.573404:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586ac00/0xf6a94c97d6611389 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.573411:0:14861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586ac00/0xf6a94c97d6611389 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.573420:0:14861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586ac00/0xf6a94c97d6611389 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361017.573444:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361017.573472:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361017.574234:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83766b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361017.574328:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144050048 00000100:00100000:1.0:1788361017.575372:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144050048 00000100:00100000:3.0:1788361017.575709:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361017.575719:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+12:14861:x1875232144050048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361017.575736:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361017.575756:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586a400/0xf6a94c97d6611390 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611389 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.575782:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586a400/0xf6a94c97d6611390 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611389 expref: 13 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.575792:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586a400/0xf6a94c97d6611390 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611389 expref: 13 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.575801:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586a400, rc 0) 00000100:00100000:3.0:1788361017.575871:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+13:14861:x1875232144050048:12345-0@lo:101:mount.lustre.0 Request processed in 153us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361017.575878:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788361017.575975:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361017.575992:0:14861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586ac00/0xf6a94c97d6611389 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611390 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.576001:0:14861:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586ac00/0xf6a94c97d6611389 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611390 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361017.576022:0:14861:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788361017.576039:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586ac00/0xf6a94c97d6611389 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611390 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.576047:0:14861:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586ac00/0xf6a94c97d6611389 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611390 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361017.576056:0:14861:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788361017.576062:0:14861:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361017.576067:0:14861:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788361017.576070:0:14861:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788361017.576115:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.576123:0:14861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.576131:0:14861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361017.576159:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361017.576193:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361017.576698:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361017.576760:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144050176 00000100:00100000:2.0:1788361017.576770:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144050176 00000100:00100000:2.0:1788361017.576830:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788361017.576838:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+13:14861:x1875232144050176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361017.576859:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361017.576871:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d661139e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611397 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361017.576890:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d661139e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611397 expref: 14 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361017.576900:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d661139e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611397 expref: 14 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361017.576907:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45400, rc 0) 00000100:00100000:2.0:1788361017.577027:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+14:14861:x1875232144050176:12345-0@lo:101:mount.lustre.0 Request processed in 190us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361017.577034:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361017.577176:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361017.577194:0:14861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.577202:0:14861:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361017.578480:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788361017.579699:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361017.581462:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788361017.581555:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788361017.581752:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788361017.581958:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788361017.581999:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788361017.582030:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788361017.582277:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788361017.582289:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788361017.582380:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361017.582444:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361017.582549:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144050304 00000100:00100000:1.0:1788361017.582554:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361017.582556:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144050304 00000100:00100000:2.0:1788361017.582724:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788361017.582735:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+14:14861:x1875232144050304:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361017.583460:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+14:14861:x1875232144050304:12345-0@lo:501:mount.lustre.0 Request processed in 725us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361017.583469:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788361017.584030:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361017.584076:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361017.584358:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361017.584443:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361017.584491:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144050432 00000100:00100000:0.0:1788361017.584498:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144050432 00000100:00100000:0.0:1788361017.584617:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361017.584626:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+14:14861:x1875232144050432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361017.585047:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+14:14861:x1875232144050432:12345-0@lo:503:mount.lustre.0 Request processed in 421us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361017.585055:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788361017.585323:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361017.585937:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361017.586007:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361017.586059:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361017.586375:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361017.586474:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144050560 00000100:00100000:2.0:1788361017.586481:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144050560 00000100:00100000:3.0:1788361017.586719:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788361017.586728:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+14:14861:x1875232144050560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361017.586979:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+14:14861:x1875232144050560:12345-0@lo:502:mount.lustre.0 Request processed in 252us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361017.586986:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788361017.587073:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361017.587377:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788361017.587428:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788361017.587462:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788361017.587528:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788361017.587583:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788361017.587623:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788361017.587672:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788361017.587723:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788361017.587757:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788361017.587806:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788361017.587842:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788361017.587891:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788361017.587925:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361017.587972:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361017.587998:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361017.588125:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144050688 00000100:00100000:0.0:1788361017.588130:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144050688 00000100:00100000:0.0:1788361017.588161:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788361017.588168:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+14:14861:x1875232144050688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361017.588334:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+14:14861:x1875232144050688:12345-0@lo:502:mount.lustre.0 Request processed in 165us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361017.588342:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788361017.588609:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361017.588680:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788361017.588690:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788361017.590809:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788361017.590819:0:14875:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788361017.590826:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361017.590828:0:14875:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788361017.590834:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361017.590847:0:14875:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a8ab72499c0) 00000020:00000080:2.0:1788361017.590871:0:14875:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788361017.590878:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788361017.590935:0:14875:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a9efc3000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788361017.590942:0:14875:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788361017.590949:0:14875:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d66113ac 00010000:00010000:2.0:1788361017.597861:0:14875:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788361017.598502:0:14875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788361017.600695:0:14875:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788361017.601959:0:14875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788361017.601972:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361017.601979:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.601981:0:14875:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788361017.601985:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788361017.601988:0:14875:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788361017.601989:0:14875:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361017.601991:0:14875:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361017.601992:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788361017.601994:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.601995:0:14875:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788361017.601998:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361017.602000:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.602002:0:14875:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788361017.602004:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788361017.602006:0:14875:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788361017.602008:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361017.602011:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.602012:0:14875:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788361017.602014:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361017.602016:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.602017:0:14875:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788361017.602020:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788361017.602076:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361017.602080:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.602081:0:14875:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788361017.602109:0:14875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788361017.602597:0:14861:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788361017.602628:0:14861:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788361017.602691:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361017.602723:0:14861:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361017.602731:0:14861:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a9efc3000 from 1 10000000:01000000:2.0:1788361017.602734:0:14861:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788361017.602769:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361017.602777:0:14861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361017.602788:0:14861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361017.602813:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361017.602878:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361017.602921:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361017.606654:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144050816 00000100:00100000:3.0:1788361017.606669:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144050816 00000100:00100000:3.0:1788361017.606722:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788361017.606732:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+14:14861:x1875232144050816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361017.606749:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361017.606773:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586b200/0xf6a94c97d66113ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66113b3 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.606801:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586b200/0xf6a94c97d66113ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66113b3 expref: 15 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.606813:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586b200/0xf6a94c97d66113ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66113b3 expref: 15 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.606822:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586b200, rc 0) 00000100:00100000:3.0:1788361017.606900:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144050816:12345-0@lo:101:mount.lustre.0 Request processed in 170us (4022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361017.606907:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788361017.607309:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361017.607328:0:14861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.607339:0:14861:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361017.608464:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788361017.608876:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361017.609183:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788361017.609230:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788361017.609304:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788361017.609313:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788361017.609382:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361017.609442:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361017.609482:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abc9af240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361017.610689:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144050944 00000100:00100000:1.0:1788361017.610702:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144050944 00000100:00100000:1.0:1788361017.610747:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788361017.610757:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144050944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361017.611600:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144050944:12345-0@lo:501:mount.lustre.0 Request processed in 839us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361017.611611:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788361017.612676:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144050944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361017.612736:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361017.612798:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361017.612874:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abc9af240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361017.615116:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144051072 00000100:00100000:1.0:1788361017.615130:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144051072 00000100:00100000:1.0:1788361017.615336:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788361017.615348:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144051072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361017.615605:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144051072:12345-0@lo:503:mount.lustre.0 Request processed in 259us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361017.615613:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788361017.615735:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051072:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788361017.616634:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361017.616724:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361017.616786:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361017.617630:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144051200 00000100:00100000:0.0:1788361017.617639:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144051200 00000100:00100000:0.0:1788361017.617677:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788361017.617696:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144051200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361017.617912:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144051200:12345-0@lo:502:mount.lustre.0 Request processed in 218us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361017.617920:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788361017.618338:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361017.618364:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051200:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361017.618741:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788361017.618800:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788361017.618855:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788361017.618906:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788361017.618941:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788361017.618991:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788361017.619028:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788361017.619063:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788361017.619501:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361017.619636:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361017.619709:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361017.619927:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144051328 00000100:00100000:0.0:1788361017.619934:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144051328 00000100:00100000:0.0:1788361017.620014:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788361017.620023:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144051328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361017.620501:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144051328:12345-0@lo:502:mount.lustre.0 Request processed in 478us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361017.620620:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361017.620756:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788361017.620772:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:0.0:1788361017.621346:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000020:01000000:3.0:1788361017.621888:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361017.621897:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.621900:0:14879:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788361017.621907:0:14879:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a9efc3000 00000020:00000080:3.0:1788361017.621910:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361017.621917:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361017.621920:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.621921:0:14879:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788361017.621923:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361017.621926:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.621927:0:14879:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788361017.621930:0:14879:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a9efc3000 00000020:00000080:3.0:1788361017.621932:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361017.621992:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361017.621996:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.621998:0:14879:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788361017.622000:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361017.622003:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.622004:0:14879:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788361017.622008:0:14879:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8a9efc3000 00000020:00000080:3.0:1788361017.622010:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361017.622044:0:14879:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361017.622047:0:14879:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361017.622049:0:14879:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788361017.622058:0:14879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788361017.622117:0:14861:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788361017.622138:0:14861:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361017.622153:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.622165:0:14861:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361017.622342:0:14861:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788361017.622346:0:14861:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a9efc3000 10000000:01000000:3.0:1788361017.622349:0:14861:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a9efc3000 10000000:01000000:3.0:1788361017.622353:0:14861:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361017.622359:0:14861:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a9efc3000 from 1 10000000:01000000:3.0:1788361017.622362:0:14861:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361017.622396:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.622404:0:14861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.622414:0:14861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361017.622437:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361017.622489:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361017.626427:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a811ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788361017.626626:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144051456 00000100:00100000:2.0:1788361017.626635:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144051456 00000100:00100000:2.0:1788361017.626687:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788361017.626697:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144051456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361017.626713:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361017.626732:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b44800/0xf6a94c97d66113c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66113c1 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361017.626760:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b44800/0xf6a94c97d66113c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66113c1 expref: 16 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361017.626771:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8b44800/0xf6a94c97d66113c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66113c1 expref: 16 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361017.626781:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44800, rc 0) 00000100:00100000:2.0:1788361017.626852:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14861:x1875232144051456:12345-0@lo:101:mount.lustre.0 Request processed in 156us (4362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361017.626859:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788361017.628372:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361017.628397:0:14861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361017.628422:0:14861:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361017.629138:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788361017.632664:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361017.632980:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788361017.633025:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788361017.633058:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788361017.633130:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788361017.633169:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788361017.634995:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788361017.635054:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788361017.635109:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788361017.635187:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788361017.636331:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788361017.636378:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788361017.636434:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788361017.636471:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788361017.636503:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788361017.636686:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788361017.636724:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788361017.636759:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788361017.636828:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788361017.636868:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788361017.636906:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788361017.636952:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788361017.636985:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788361017.637035:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788361017.637106:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788361017.637147:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788361017.640661:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788361017.640804:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788361017.640845:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788361017.640933:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788361017.640941:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788361017.641045:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361017.641125:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361017.641175:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a811ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788361017.641334:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144051584 00000100:00100000:2.0:1788361017.641342:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144051584 00000100:00100000:2.0:1788361017.641390:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788361017.641399:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14861:x1875232144051584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361017.642580:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14861:x1875232144051584:12345-0@lo:501:mount.lustre.0 Request processed in 1176us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361017.642592:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788361017.643048:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361017.643121:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361017.643180:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361017.654796:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a811ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361017.655058:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144051712 00000100:00100000:0.0:1788361017.655066:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144051712 00000100:00100000:0.0:1788361017.658671:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788361017.658687:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14861:x1875232144051712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361017.658921:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14861:x1875232144051712:12345-0@lo:503:mount.lustre.0 Request processed in 239us (15749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361017.658931:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788361017.659227:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051712:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788361017.659768:0:14861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361017.659840:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361017.659894:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361017.659935:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a829ec600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361017.661499:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144051840 00000100:00100000:2.0:1788361017.661588:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144051840 00000100:00100000:2.0:1788361017.661643:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788361017.661654:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14861:x1875232144051840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361017.661921:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14861:x1875232144051840:12345-0@lo:502:mount.lustre.0 Request processed in 268us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361017.661929:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788361017.662126:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361017.662641:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788361017.662701:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788361017.662735:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788361017.662783:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788361017.662820:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788361017.662862:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788361017.662915:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788361017.662952:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788361017.663000:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788361017.663039:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788361017.663112:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788361017.663166:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788361017.664635:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788361017.664682:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788361017.664755:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788361017.664812:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788361017.664850:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788361017.664902:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788361017.664938:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788361017.664969:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788361017.665028:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788361017.665068:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788361017.665151:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788361017.666645:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788361017.666725:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788361017.666762:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788361017.666817:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788361017.666857:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788361017.666894:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788361017.666945:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788361017.666984:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788361017.667045:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788361017.667081:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788361017.667162:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788361017.667200:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788361017.667381:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788361017.667419:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788361017.667473:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788361017.667611:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788361017.667651:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788361017.667701:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84855880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361017.667775:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361017.667817:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361017.667908:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144051968 00000100:00100000:3.0:1788361017.667915:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144051968 00000100:00100000:3.0:1788361017.667965:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788361017.667973:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14861:x1875232144051968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361017.668221:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14861:x1875232144051968:12345-0@lo:502:mount.lustre.0 Request processed in 235us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361017.668230:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361017.668412:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84855880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144051968:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361017.668484:0:14861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788361017.668493:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788361017.671871:0:14884:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788361017.671888:0:14884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a8ab724cd40) 00000020:00000080:2.0:1788361017.671908:0:14884:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788361017.672710:0:14884:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a9efc3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788361017.672716:0:14884:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a9efc3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788361017.672719:0:14884:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a9efc3000 3 00010000:00080000:2.0:1788361017.672752:0:14884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a89248000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.160@tcp at head 00010000:00010000:2.0:1788361017.675960:0:14884:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788361017.676075:0:14884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788361017.676139:0:14884:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788361017.676154:0:14884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf6a94c97d66113d6 00000100:00080000:2.0:1788361017.676164:0:14884:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788361017.676170:0:14884:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8a89248000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361017.676597:0:14884:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a84855880 x1875232144052096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361017.676673:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144052096:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361017.676743:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361017.676801:0:14884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788361017.677785:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788361017.677791:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788361017.677794:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788361017.677797:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788361017.678144:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144052224:0@lo:400:kworker.0 00000100:00100000:1.0:1788361017.678454:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361017.679364:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144052096 00000100:00100000:2.0:1788361017.679373:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144052096 00000100:00100000:2.0:1788361017.679407:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144052224 00000100:00100000:2.0:1788361017.679410:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144052224 00000100:00100000:2.0:1788361017.679437:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361017.679447:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144052224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361017.679531:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144052224:12345-0@lo:400:kworker.0 Request processed in 86us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361017.679538:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361017.679554:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361017.679559:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144052096:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788361017.679579:0:14227:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:2.0:1788361017.679614:0:14227:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf6a94c97d66113dd 00000004:00100000:2.0:1788361017.679629:0:14227:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788361017.679664:0:14227:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361017.682658:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875232144052096:12345-0@lo:38:llog_process_th.0 Request processed in 3087us (5904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361017.682672:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788361017.682743:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8ac0874700 x1875232144052224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361017.682759:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144052224:0@lo:400:kworker.0 00000040:00080000:2.0:1788361017.684490:0:14884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:3.0:1788361017.685418:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8a84855880 x1875232144052096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361017.685430:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361017.685439:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788361017.685446:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788361017.685452:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361017.685455:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a89248000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361017.685461:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144052096:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788361017.685648:0:14861:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788361017.685679:0:14861:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361017.685714:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361017.685723:0:14861:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788361017.685772:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788361017.685774:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361017.685775:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361017.685777:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361017.685778:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361017.685780:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361017.685781:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361017.685783:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361017.685785:0:14861:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788361017.685789:0:14861:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788361017.685792:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788361017.685793:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361017.685794:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361017.685796:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361017.685797:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361017.685798:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361017.685799:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361017.685800:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361017.685801:0:14861:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788361017.685821:0:14861:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788361017.685837:0:14861:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144052352:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788361017.685896:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361017.685936:0:14861:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361017.686328:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144052352 00000100:00100000:3.0:1788361017.686335:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144052352 00000100:00100000:3.0:1788361017.686379:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788361017.686388:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14861:x1875232144052352:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361017.686417:0:14221:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788361017.686431:0:14221:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361017.723818:0:14221:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361017.723833:0:14221:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788361017.723862:0:14242:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361017.723867:0:14242:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361017.723890:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.723909:0:14242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d6611351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661134a expref: 16 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.723917:0:14242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.723955:0:14242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d6611351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661134a expref: 16 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.723970:0:14242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d6611351 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661134a expref: 16 pid: 14218 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361017.723986:0:14242:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14242:1875232144052480:0@lo:104: 00000100:00100000:1.0:1788361017.724064:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361017.724133:0:14242:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90955780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361017.724163:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144052480 00000100:00100000:1.0:1788361017.724182:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144052480 00000100:00100000:1.0:1788361017.724230:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361017.724240:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+3:14242:x1875232144052480:12345-0@lo:104: 00010000:00010000:1.0:1788361017.724266:0:14210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724315:0:14210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361017.724333:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+3:14242:x1875232144052480:12345-0@lo:104: Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361017.724340:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361017.724381:0:14242:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14242:1875232144052480:0@lo:104: 00010000:00010000:1.0:1788361017.724399:0:14242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724415:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361017.724421:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724429:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586b800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361017.724433:0:14215:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724441:0:14215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361017.724448:0:14215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361017.724454:0:14215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361017.724479:0:14215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724485:0:14215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361017.724503:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724645:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586b800/0xf6a94c97d661134a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611351 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724668:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361017.724670:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361017.724672:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361017.724694:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144052608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361017.724723:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361017.724764:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144052608 00000100:00100000:1.0:1788361017.724768:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144052608 00010000:00010000:1.0:1788361017.724785:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d6611351 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661134a expref: 17 pid: 14218 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361017.724805:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361017.724813:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b97d369-4bf1-43ee-a977-45b88f10e003+17:3311:x1875232144052608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361017.724840:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361017.724846:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d6611351 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661134a expref: 17 pid: 14218 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724856:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d6611351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661134a expref: 17 pid: 14218 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724871:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab705b600/0xf6a94c97d6611351 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661134a expref: 17 pid: 14218 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724884:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724892:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361017.724904:0:14213:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002802561s 00010000:00010000:1.0:1788361017.724914:0:14213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724921:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724928:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724934:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724940:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361017.724944:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724952:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724965:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.724974:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361017.725001:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b97d369-4bf1-43ee-a977-45b88f10e003+16:3311:x1875232144052608:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361017.725008:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788361017.725030:0:14242:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.725037:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361017.725052:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361017.725082:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144052608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361017.732835:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14861:x1875232144052352:12345-0@lo:253:mount.lustre.0 Request processed in 46438us (46929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361017.732866:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788361017.732978:0:14861:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:14861:1875232144052352:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788361017.732995:0:14861:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788361017.732999:0:14861:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361017.733001:0:14861:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361017.733003:0:14861:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361017.733004:0:14861:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361017.733005:0:14861:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361017.733007:0:14861:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361017.733008:0:14861:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361017.733011:0:14861:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361017.733012:0:14861:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788361017.733028:0:14861:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788361017.738650:0:14861:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361017.738819:0:14861:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788361017.738979:0:14861:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361017.739279:0:14861:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788361017.739430:0:14861:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361017.739599:0:14861:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788361017.740876:0:14861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788361017.794283:0:14861:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788361017.794294:0:14861:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788361017.794406:0:14861:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788361017.794468:0:14861:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788361017.794484:0:14861:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788361017.794581:0:14861:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788361017.889707:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788361018.853029:0:14223:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788361018.853036:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a89871ae800 from 7 10000000:01000000:1.0:1788361018.853040:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788361018.853080:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361018.853104:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361018.853123:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361018.853150:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144052736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361018.853215:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361018.853277:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83c98b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361018.853310:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144052736 00000100:00100000:1.0:1788361018.853316:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144052736 00000100:00100000:1.0:1788361018.853360:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788361018.853368:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+15:14223:x1875232144052736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361018.853381:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361018.853394:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66113eb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361018.853418:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66113eb expref: 16 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361018.853430:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66113eb expref: 16 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361018.853438:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705a200, rc 0) 00000100:00100000:1.0:1788361018.853478:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14223:x1875232144052736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361018.853484:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788361018.853529:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144052736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361018.853541:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361018.853557:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361018.853602:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144052864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788361018.853631:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361018.853650:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83c98b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361018.854068:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144052864 00000100:00100000:3.0:1788361018.854073:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144052864 00000100:00100000:3.0:1788361018.854139:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788361018.854148:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14223:x1875232144052864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361018.854162:0:14221:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788361018.854176:0:14221:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361018.854179:0:14221:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788361018.854263:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14223:x1875232144052864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361018.854270:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788361018.854786:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144052864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788361018.854843:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361018.854851:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361018.854859:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361018.912256:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361019.296754:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788361019.936297:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361020.960701:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361021.984287:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361023.008432:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361023.118887:0:15227:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788361023.136618:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361023.136625:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788361023.136629:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361023.136632:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788361023.136669:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361023.136690:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144052992:0@lo:400:kworker.0 00000100:00100000:3.0:1788361023.136767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361023.136818:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144053120:0@lo:400:kworker.0 00000100:00100000:3.0:1788361023.136844:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361023.136876:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361023.136882:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144053248:0@lo:400:kworker.0 00000100:00100000:3.0:1788361023.136904:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361023.136936:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144052992 00000100:00100000:3.0:1788361023.136944:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144052992 00000100:00100000:3.0:1788361023.136987:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361023.136995:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+16:3311:x1875232144052992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361023.137044:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+16:3311:x1875232144052992:12345-0@lo:400:kworker.0 Request processed in 49us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361023.137051:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361023.137119:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144053120 00000100:00100000:3.0:1788361023.137123:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144053120 00000100:00100000:3.0:1788361023.137148:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144053248 00000100:00100000:3.0:1788361023.137151:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144053248 00000100:00100000:0.0:1788361023.137245:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361023.137254:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144053120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361023.137294:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144053120:12345-0@lo:400:kworker.0 Request processed in 41us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361023.137300:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361023.140647:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361023.140660:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144053248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361023.140744:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144053248:12345-0@lo:400:kworker.0 Request processed in 87us (3837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361023.140751:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788361023.140814:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a50a80 x1875232144053248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361023.140830:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144053248:0@lo:400:kworker.0 00010000:00080000:3.0:1788361023.140843:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a52d80 x1875232144053120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361023.140852:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144053120:0@lo:400:kworker.0 00000100:00100000:3.0:1788361023.140885:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144052992:0@lo:400:kworker.0 00000100:00080000:3.0:1788361023.140941:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788361024.033284:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361025.057522:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361026.082474:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361027.108662:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361028.131410:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361028.256291:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361028.256299:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788361028.256302:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361028.256305:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788361028.256360:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144053504:0@lo:400:kworker.0 00000100:00100000:3.0:1788361028.256433:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.256503:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361028.256510:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b97d369-4bf1-43ee-a977-45b88f10e003:3312:1875232144053376:0@lo:400:kworker.0 00000100:00100000:3.0:1788361028.256540:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.256573:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144053632:0@lo:400:kworker.0 00000100:00100000:3.0:1788361028.256597:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.256633:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144053504 00000100:00100000:3.0:1788361028.256641:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144053504 00000100:00100000:3.0:1788361028.256698:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144053632 00000100:00100000:3.0:1788361028.256702:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144053632 00000100:00100000:3.0:1788361028.256730:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361028.256739:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144053504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361028.256794:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144053504:12345-0@lo:400:kworker.0 Request processed in 56us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361028.256802:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361028.256818:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361028.256825:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144053632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361028.256857:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144053632:12345-0@lo:400:kworker.0 Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361028.256872:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361028.256891:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144053376 00000100:00100000:3.0:1788361028.256895:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144053376 00000100:00100000:3.0:1788361028.256919:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788361028.256925:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+16:3312:x1875232144053376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361028.256954:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+16:3312:x1875232144053376:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361028.256960:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788361028.256991:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788361028.257034:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a50a80 x1875232144053632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361028.257049:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144053632:0@lo:400:kworker.0 00000100:00100000:3.0:1788361028.257077:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b97d369-4bf1-43ee-a977-45b88f10e003:3312:1875232144053376:0@lo:400:kworker.0 00010000:00080000:3.0:1788361028.257115:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a52d80 x1875232144053504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361028.257124:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144053504:0@lo:400:kworker.0 00000020:01000004:1.0:1788361028.332491:0:15528:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788361028.332496:0:15528:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788361028.332665:0:15528:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8a8a10b000 00000020:01000004:1.0:1788361028.332681:0:15528:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788361028.332692:0:15528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788361028.332705:0:15528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a8a85710000) 00000020:00000080:1.0:1788361028.332719:0:15528:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788361028.361837:0:15528:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788361028.362726:0:15528:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788361028.364513:0:15528:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788361028.364781:0:15528:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788361028.367651:0:15528:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788361028.370622:0:15528:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 589: rc = 0 00100000:10000000:2.0:1788361028.370890:0:15528:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 589: rc = 0 00100000:10000000:2.0:1788361028.370997:0:15528:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 589: rc = 0 00100000:10000000:2.0:1788361028.372704:0:15528:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 776: rc = 0 00100000:10000000:2.0:1788361028.372984:0:15528:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 776: rc = 0 00100000:10000000:2.0:1788361028.373292:0:15528:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 776: rc = 0 00100000:10000000:2.0:1788361028.375582:0:15528:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 776: rc = 0 00100000:10000000:2.0:1788361028.378529:0:15528:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 776: rc = 0 00100000:10000000:2.0:1788361028.378850:0:15528:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 776: rc = 0 00000020:00000080:2.0:1788361028.379388:0:15528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788361028.379401:0:15528:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788361028.379412:0:15528:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d6611400 00000020:01000004:2.0:1788361028.379421:0:15528:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788361028.379442:0:15528:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788361028.379446:0:15528:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788361028.379451:0:15528:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788361028.379479:0:15528:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788361028.379484:0:15528:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788361028.395452:0:15528:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788361028.395493:0:15528:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.160@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788361028.395497:0:15528:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788361028.395499:0:15528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361028.395501:0:15528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361028.395502:0:15528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361028.395503:0:15528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361028.395505:0:15528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361028.395506:0:15528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361028.395508:0:15528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361028.395509:0:15528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361028.395518:0:15528:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788361028.395520:0:15528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361028.395521:0:15528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361028.395522:0:15528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361028.395523:0:15528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361028.395524:0:15528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361028.395525:0:15528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361028.395526:0:15528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361028.395528:0:15528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361028.395528:0:15528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361028.395553:0:15528:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788361028.395573:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144053760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361028.395641:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.395759:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.396462:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144053760 00000100:00100000:0.0:1788361028.396471:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144053760 00000100:00100000:0.0:1788361028.396655:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788361028.396666:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+16:15528:x1875232144053760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361028.396698:0:14221:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788361028.396702:0:14221:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788361028.396706:0:14221:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788361028.406848:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+16:15528:x1875232144053760:12345-0@lo:253:mount.lustre.0 Request processed in 10173us (11196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.406866:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361028.406965:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144053760:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361028.406982:0:15528:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788361028.406985:0:15528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361028.406987:0:15528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361028.406988:0:15528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361028.406990:0:15528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361028.406991:0:15528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361028.406992:0:15528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361028.406994:0:15528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361028.406996:0:15528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361028.406997:0:15528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788361028.407020:0:15528:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8a8a10b000 from lustre-OST0001 10000000:01000000:3.0:1788361028.407046:0:15528:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788361028.407050:0:15528:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788361028.407058:0:15528:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a898536cd40 local copy 00010000:00010000:3.0:1788361028.407664:0:15528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361028.407943:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144053888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361028.407997:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.408419:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.408587:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144053888 00000100:00100000:0.0:1788361028.408596:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144053888 00000100:00100000:0.0:1788361028.409114:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788361028.409126:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+16:15528:x1875232144053888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361028.409693:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+16:15528:x1875232144053888:12345-0@lo:501:mount.lustre.0 Request processed in 559us (1685us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361028.409702:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788361028.409801:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144053888:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788361028.409822:0:15528:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788361028.409991:0:15528:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788361028.409999:0:15528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361028.410016:0:15528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361028.410046:0:15528:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8a8a10b000 10000000:01000000:1.0:1788361028.410050:0:15528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788361028.410056:0:15528:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788361028.410059:0:15528:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361028.410495:0:15528:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788361028.410499:0:15528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788361028.410531:0:15528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361028.410539:0:15528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361028.410549:0:15528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361028.410569:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361028.410607:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361028.410774:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.410814:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144054016 00000100:00100000:0.0:1788361028.410821:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144054016 00000100:00100000:0.0:1788361028.410855:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788361028.410864:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+16:15528:x1875232144054016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361028.410875:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361028.410888:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8c42400/0xf6a94c97d661140e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611407 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361028.410910:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8c42400/0xf6a94c97d661140e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611407 expref: 17 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361028.410920:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8c42400/0xf6a94c97d661140e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611407 expref: 17 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361028.410943:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42400, rc 0) 00000100:00100000:0.0:1788361028.411025:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+17:15528:x1875232144054016:12345-0@lo:101:mount.lustre.0 Request processed in 162us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.411032:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788361028.411163:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361028.411186:0:15528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361028.411195:0:15528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361028.412234:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788361028.413917:0:15528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361028.414578:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788361028.414628:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788361028.414660:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788361028.414716:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788361028.414749:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788361028.414775:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788361028.414840:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788361028.414849:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788361028.414948:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361028.415016:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361028.415059:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.415285:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144054144 00000100:00100000:0.0:1788361028.415294:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144054144 00000100:00100000:0.0:1788361028.415349:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361028.415359:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf24b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+17:15528:x1875232144054144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361028.416376:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf24b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+17:15528:x1875232144054144:12345-0@lo:501:mount.lustre.0 Request processed in 1016us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.416388:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788361028.416956:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361028.417017:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361028.417069:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361028.417136:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.417282:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144054272 00000100:00100000:0.0:1788361028.417288:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144054272 00000100:00100000:0.0:1788361028.417332:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788361028.417341:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+17:15528:x1875232144054272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361028.417997:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+17:15528:x1875232144054272:12345-0@lo:503:mount.lustre.0 Request processed in 655us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.418005:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788361028.418410:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361028.419329:0:15528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361028.419428:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361028.419565:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361028.419666:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361028.419771:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144054400 00000100:00100000:3.0:1788361028.419778:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144054400 00000100:00100000:3.0:1788361028.419868:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788361028.419878:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf24a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+17:15528:x1875232144054400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361028.420236:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf24a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+17:15528:x1875232144054400:12345-0@lo:502:mount.lustre.0 Request processed in 359us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361028.420244:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788361028.420461:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361028.420855:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788361028.420909:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788361028.420958:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788361028.421012:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788361028.421051:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788361028.421274:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788361028.421334:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788361028.421372:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788361028.421424:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788361028.421531:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361028.421592:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361028.421671:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361028.421784:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144054528 00000100:00100000:3.0:1788361028.421791:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144054528 00000100:00100000:3.0:1788361028.421839:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788361028.421847:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf24ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+17:15528:x1875232144054528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361028.422040:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf24ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+17:15528:x1875232144054528:12345-0@lo:502:mount.lustre.0 Request processed in 193us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361028.422047:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788361028.422167:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361028.422248:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788361028.422260:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788361028.423890:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788361028.423901:0:15529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788361028.423908:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361028.423911:0:15529:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788361028.423918:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361028.423934:0:15529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a8ab77a4d40) 00000020:00000080:2.0:1788361028.423957:0:15529:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788361028.423963:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788361028.424028:0:15529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a8a10b000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788361028.424034:0:15529:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788361028.424041:0:15529:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d661141c 00010000:00010000:2.0:1788361028.435938:0:15529:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788361028.437432:0:15529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788361028.441215:0:15529:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788361028.444426:0:15529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788361028.444448:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361028.444455:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361028.444457:0:15529:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788361028.444461:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361028.444465:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361028.444466:0:15529:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788361028.444469:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788361028.444471:0:15529:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788361028.444474:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361028.444476:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361028.444477:0:15529:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788361028.444480:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361028.444490:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361028.444492:0:15529:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788361028.444496:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788361028.444572:0:15529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361028.444576:0:15529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361028.444577:0:15529:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788361028.444581:0:15529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788361028.444892:0:15528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788361028.444923:0:15528:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788361028.444942:0:15528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.444954:0:15528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361028.444961:0:15528:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a8a10b000 from 1 10000000:01000000:3.0:1788361028.444964:0:15528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361028.445005:0:15528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.445013:0:15528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.445032:0:15528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361028.445062:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361028.445167:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.445216:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144054656 00000100:00100000:3.0:1788361028.445223:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144054656 00000100:00100000:3.0:1788361028.445325:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788361028.445334:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+17:15528:x1875232144054656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361028.445347:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361028.445359:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661142a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611423 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.445382:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661142a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611423 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.445393:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661142a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611423 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.445404:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a898586bc00, rc 0) 00000100:00100000:3.0:1788361028.445774:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144054656:12345-0@lo:101:mount.lustre.0 Request processed in 439us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361028.445782:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788361028.445827:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a87cdd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788361028.445851:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361028.445865:0:15528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.445882:0:15528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361028.447867:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788361028.448991:0:15528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361028.449313:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788361028.449356:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788361028.449419:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788361028.449428:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788361028.449523:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361028.449592:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.453407:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.454645:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144054784 00000100:00100000:0.0:1788361028.454660:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144054784 00000100:00100000:0.0:1788361028.454717:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788361028.454727:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf24a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144054784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361028.455049:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf24a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144054784:12345-0@lo:501:mount.lustre.0 Request processed in 323us (5456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.455057:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788361028.456225:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361028.456302:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361028.456371:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.456412:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.456626:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144054912 00000100:00100000:0.0:1788361028.456633:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144054912 00000100:00100000:0.0:1788361028.456673:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788361028.456682:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144054912:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361028.456948:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144054912:12345-0@lo:503:mount.lustre.0 Request processed in 265us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.456956:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788361028.457390:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144054912:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788361028.460040:0:15528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361028.460873:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361028.460954:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.461055:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361028.465002:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144055040 00000100:00100000:1.0:1788361028.465018:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144055040 00000100:00100000:1.0:1788361028.465105:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788361028.465115:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144055040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361028.465760:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144055040:12345-0@lo:502:mount.lustre.0 Request processed in 644us (4803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361028.465769:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788361028.469826:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361028.470800:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788361028.470877:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788361028.470930:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788361028.470984:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788361028.471022:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788361028.471536:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788361028.471582:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788361028.471614:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788361028.471668:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361028.471832:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.471883:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.471953:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144055168 00000100:00100000:0.0:1788361028.471962:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144055168 00000100:00100000:0.0:1788361028.472056:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788361028.472078:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144055168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361028.472335:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144055168:12345-0@lo:502:mount.lustre.0 Request processed in 269us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.472343:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788361028.472467:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361028.472571:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788361028.472582:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788361028.473970:0:15533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361028.473982:0:15533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361028.473984:0:15533:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788361028.473990:0:15533:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a8a10b000 00000020:00000080:3.0:1788361028.473993:0:15533:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361028.474002:0:15533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361028.474004:0:15533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361028.474006:0:15533:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788361028.474009:0:15533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361028.474011:0:15533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361028.474012:0:15533:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788361028.474015:0:15533:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a8a10b000 00000020:00000080:3.0:1788361028.474017:0:15533:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361028.474185:0:15533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361028.474190:0:15533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361028.474192:0:15533:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788361028.474194:0:15533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361028.474196:0:15533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361028.474198:0:15533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788361028.474201:0:15533:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8a8a10b000 00000020:00000080:3.0:1788361028.474203:0:15533:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361028.475832:0:15533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361028.475841:0:15533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361028.475849:0:15533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788361028.475853:0:15533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788361028.476787:0:15528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788361028.476819:0:15528:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788361028.476847:0:15528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361028.476859:0:15528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361028.476913:0:15528:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788361028.476916:0:15528:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a8a10b000 10000000:01000000:2.0:1788361028.476919:0:15528:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a8a10b000 10000000:01000000:2.0:1788361028.476923:0:15528:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788361028.476929:0:15528:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a8a10b000 from 1 10000000:01000000:2.0:1788361028.476932:0:15528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788361028.476973:0:15528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361028.476982:0:15528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361028.476994:0:15528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361028.477019:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361028.477811:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361028.477853:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.477901:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144055296 00000100:00100000:0.0:1788361028.477909:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144055296 00000100:00100000:0.0:1788361028.477957:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788361028.477966:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144055296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361028.477980:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361028.477995:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8aa8c43400/0xf6a94c97d6611438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611431 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361028.478021:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8c43400/0xf6a94c97d6611438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611431 expref: 19 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361028.478034:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8aa8c43400/0xf6a94c97d6611438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611431 expref: 19 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361028.478056:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c43400, rc 0) 00000100:00100000:0.0:1788361028.478460:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:15528:x1875232144055296:12345-0@lo:101:mount.lustre.0 Request processed in 494us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.478468:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788361028.480319:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361028.480354:0:15528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.480366:0:15528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361028.481652:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788361028.485504:0:15528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361028.485993:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788361028.486047:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788361028.486118:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788361028.486192:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788361028.486506:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788361028.486586:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788361028.486625:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788361028.486675:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788361028.487382:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788361028.487421:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788361028.488574:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788361028.488664:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788361028.490267:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788361028.490344:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788361028.490700:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788361028.490765:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788361028.490812:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788361028.490863:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788361028.490901:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788361028.490935:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788361028.490984:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788361028.491033:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788361028.491082:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788361028.491185:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788361028.491221:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788361028.492374:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788361028.492549:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788361028.492595:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788361028.492633:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788361028.492693:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788361028.492733:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788361028.492766:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788361028.492798:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788361028.492841:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788361028.492876:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788361028.492918:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788361028.492951:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788361028.493047:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788361028.493055:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788361028.493199:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361028.493537:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.493596:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.494223:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144055424 00000100:00100000:0.0:1788361028.494299:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144055424 00000100:00100000:0.0:1788361028.494390:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788361028.494401:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:15528:x1875232144055424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361028.494676:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:15528:x1875232144055424:12345-0@lo:501:mount.lustre.0 Request processed in 278us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.494685:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788361028.494976:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361028.495022:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361028.497507:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.497611:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.498015:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144055552 00000100:00100000:0.0:1788361028.498025:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144055552 00000100:00100000:0.0:1788361028.498167:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788361028.498188:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:15528:x1875232144055552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361028.499384:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:15528:x1875232144055552:12345-0@lo:503:mount.lustre.0 Request processed in 1192us (4312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.499397:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788361028.503839:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055552:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788361028.505927:0:15528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361028.506023:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84854a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361028.506134:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361028.506281:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144055680 00000100:00100000:0.0:1788361028.506291:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144055680 00000100:00100000:0.0:1788361028.506338:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788361028.506348:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abcbf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+19:15528:x1875232144055680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361028.506641:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abcbf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+19:15528:x1875232144055680:12345-0@lo:502:mount.lustre.0 Request processed in 293us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.506650:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788361028.510129:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361028.510238:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84854a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361028.510749:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788361028.510887:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788361028.510927:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788361028.510974:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788361028.511010:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788361028.511073:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788361028.511131:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788361028.511514:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788361028.511575:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788361028.511608:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788361028.512009:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788361028.512071:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788361028.512141:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788361028.512242:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788361028.512296:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788361028.512332:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788361028.512366:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788361028.512416:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788361028.513892:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788361028.513974:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788361028.514055:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788361028.514155:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788361028.517042:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788361028.517573:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788361028.517619:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788361028.517678:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788361028.517731:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788361028.517776:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788361028.517937:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788361028.517992:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788361028.518036:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788361028.518069:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788361028.518366:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788361028.518429:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788361028.518554:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788361028.518607:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788361028.518645:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788361028.518678:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788361028.518759:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788361028.518799:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788361028.519945:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361028.520038:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.520105:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361028.520426:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144055808 00000100:00100000:0.0:1788361028.520509:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144055808 00000100:00100000:0.0:1788361028.520563:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788361028.520573:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:15528:x1875232144055808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361028.521462:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:15528:x1875232144055808:12345-0@lo:502:mount.lustre.0 Request processed in 885us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361028.521473:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788361028.522001:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144055808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361028.522182:0:15528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788361028.522199:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788361028.524030:0:15538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788361028.524060:0:15538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a8984a58000) 00000020:00000080:3.0:1788361028.524193:0:15538:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788361028.524853:0:15538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a8a10b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788361028.524858:0:15538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a8a10b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788361028.524861:0:15538:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8a10b000 3 00010000:00080000:3.0:1788361028.524898:0:15538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a9efc8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361028.529496:0:15538:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788361028.529602:0:15538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788361028.529640:0:15538:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788361028.529653:0:15538:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf6a94c97d6611446 00000100:00080000:3.0:1788361028.529668:0:15538:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361028.529674:0:15538:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8a9efc8000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361028.529859:0:15538:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0a53800 x1875232144055936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361028.529892:0:15538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788361028.530039:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144055936:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788361028.530067:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361028.530074:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788361028.530077:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361028.530080:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788361028.530157:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.530203:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144055936 00000100:00100000:3.0:1788361028.530213:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144055936 00000100:00100000:3.0:1788361028.530266:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361028.530274:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144055936:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788361028.530298:0:14227:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:3.0:1788361028.530327:0:14227:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf6a94c97d661144d 00000004:00100000:3.0:1788361028.530346:0:14227:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788361028.530376:0:14227:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48c000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788361028.530398:0:15538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1788361028.530430:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875232144055936:12345-0@lo:38:llog_process_th.0 Request processed in 155us (273us total) trans 0 rc 0/0 00000020:01000000:0.0:1788361028.530524:0:15528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788361028.530549:0:15528:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:3.0:1788361028.530562:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788361028.530565:0:15528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361028.530576:0:15528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788361028.530607:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a53800 x1875232144055936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361028.530618:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361028.530626:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788361028.530634:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788361028.530640:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361028.530642:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efc8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361028.530647:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144055936:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788361028.530650:0:15528:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788361028.530652:0:15528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361028.530654:0:15528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361028.530655:0:15528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361028.530656:0:15528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361028.530657:0:15528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361028.530659:0:15528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361028.530661:0:15528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361028.530662:0:15528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361028.530668:0:15528:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788361028.530670:0:15528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361028.530672:0:15528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361028.530673:0:15528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361028.530674:0:15528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361028.530675:0:15528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361028.530676:0:15528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361028.530678:0:15528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361028.530679:0:15528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361028.530680:0:15528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361028.530702:0:15528:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788361028.530714:0:15528:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144056064:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361028.530750:0:15528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361028.530783:0:15528:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a890266c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361028.530802:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144056064 00000100:00100000:3.0:1788361028.530813:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144056064 00000100:00100000:3.0:1788361028.530844:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788361028.530851:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:15528:x1875232144056064:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361028.530871:0:14220:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788361028.530886:0:14220:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361028.570354:0:14220:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361028.570408:0:14220:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788361028.575199:0:14242:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788361028.575209:0:14242:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788361028.575244:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361028.575266:0:14242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66113eb expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361028.575275:0:14242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361028.575315:0:14242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66113eb expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361028.575329:0:14242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66113eb expref: 19 pid: 14220 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361028.575345:0:14242:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84854a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14242:1875232144056192:0@lo:104: 00000100:00100000:2.0:1788361028.575413:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361028.575469:0:14242:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361028.575598:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144056192 00000100:00100000:3.0:1788361028.575605:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144056192 00000100:00100000:3.0:1788361028.575655:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361028.575664:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+3:14242:x1875232144056192:12345-0@lo:104: 00010000:00010000:3.0:1788361028.575676:0:14209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.575742:0:14209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788361028.575749:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+3:14242:x1875232144056192:12345-0@lo:104: Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361028.575756:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788361028.575776:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361028.575782:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.575788:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361028.575792:0:14215:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.575800:0:14215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361028.575808:0:14215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361028.575830:0:14215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361028.575858:0:14215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.575865:0:14215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361028.575883:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.575890:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b600/0xf6a94c97d66113eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66113f2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.575907:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361028.575908:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361028.575910:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361028.575930:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144056320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361028.575959:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361028.576011:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144056320 00000100:00100000:3.0:1788361028.576016:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144056320 00010000:00010000:3.0:1788361028.576034:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66113eb expref: 20 pid: 14220 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361028.576056:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361028.576062:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b97d369-4bf1-43ee-a977-45b88f10e003+20:3314:x1875232144056320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361028.576071:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361028.576076:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66113eb expref: 20 pid: 14220 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576119:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66113eb expref: 20 pid: 14220 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576141:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576148:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788361028.576160:0:14213:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002802561s 00010000:00010000:3.0:1788361028.576165:0:14213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576183:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576190:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576196:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576201:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361028.576205:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576213:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576222:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576239:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361028.576270:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b97d369-4bf1-43ee-a977-45b88f10e003+20:3314:x1875232144056320:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361028.576288:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361028.576334:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144056320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361028.576362:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab705a200/0xf6a94c97d66113f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66113eb expref: 19 pid: 14220 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361028.576372:0:14242:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84854a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14242:1875232144056192:0@lo:104: 00010000:00010000:3.0:1788361028.576386:0:14242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576395:0:14242:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576400:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361028.576406:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b45200/0xf6a94c97d6611454 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361028.579357:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:15528:x1875232144056064:12345-0@lo:253:mount.lustre.0 Request processed in 48492us (48592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361028.579376:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788361028.579619:0:15528:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b97d369-4bf1-43ee-a977-45b88f10e003:15528:1875232144056064:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361028.579635:0:15528:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788361028.579637:0:15528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361028.579639:0:15528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361028.579640:0:15528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361028.579641:0:15528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361028.579642:0:15528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361028.579644:0:15528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361028.579645:0:15528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361028.579647:0:15528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361028.579649:0:15528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788361028.579664:0:15528:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788361028.585061:0:15528:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361028.586114:0:15528:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361028.586420:0:15528:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361028.586657:0:15528:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361028.586872:0:15528:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361028.587276:0:15528:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788361028.588076:0:15528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788361028.666714:0:15528:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788361028.666723:0:15528:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788361028.666756:0:15528:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788361028.666817:0:15528:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788361028.666837:0:15528:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788361028.666867:0:15528:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788361029.155075:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361029.537792:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788361029.792747:0:14223:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361029.792758:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a89871ae800 from 8 10000000:01000000:3.0:1788361029.792763:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361029.792824:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361029.792844:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361029.792855:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361029.792906:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144056448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361029.792986:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361029.793130:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361029.794011:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144056448 00000100:00100000:0.0:1788361029.794023:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144056448 00000100:00100000:1.0:1788361029.794344:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788361029.794355:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+18:14223:x1875232144056448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361029.794371:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361029.794391:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab705ba00/0xf6a94c97d6611462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661145b expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361029.794435:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab705ba00/0xf6a94c97d6611462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661145b expref: 19 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361029.794447:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab705ba00/0xf6a94c97d6611462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661145b expref: 19 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361029.794456:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab705ba00, rc 0) 00000100:00100000:1.0:1788361029.794536:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+19:14223:x1875232144056448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361029.794544:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788361029.794647:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144056448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361029.794669:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361029.794678:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361029.794749:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144056576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361029.794787:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361029.794925:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361029.795051:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144056576 00000100:00100000:3.0:1788361029.795058:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144056576 00000100:00100000:3.0:1788361029.795116:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788361029.795124:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:14223:x1875232144056576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361029.795142:0:14221:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788361029.795171:0:14221:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361029.795174:0:14221:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788361029.795267:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:14223:x1875232144056576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361029.795274:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788361029.795403:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144056576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788361029.795458:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788361029.795466:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361029.795474:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361030.176253:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361031.201291:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361031.584524:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361016/real 1788361016] req@ffff9a8a90b2f100 x1875232144049408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361031 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361031.584558:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8a90b2f100 x1875232144049408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361031 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361031.584567:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361016/real 1788361016] req@ffff9a8a90b2e300 x1875232144049536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361031 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361031.584578:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8a90b2e300 x1875232144049536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361031 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361031.584598:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8aae465800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361031.584667:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788361031.584672:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144049408:0@lo:8:kworker.0 00000100:00080000:1.0:1788361031.584679:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8abf244000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361031.585691:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361031.585696:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788361031.585699:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8aae465800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361031.585705:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:0.0:1788361031.585710:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788361031.585717:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8aae465800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361031.585737:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a90b2f800 x1875232144056832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361031.585762:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361031.585765:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788361031.585767:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8abf244000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361031.585770:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:0.0:1788361031.585773:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788361031.585777:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8abf244000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361031.585790:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a90b2c000 x1875232144056960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361031.585954:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144056704:0@lo:400:kworker.0 00000100:00100000:3.0:1788361031.586020:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361031.586077:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361031.586101:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144057088:0@lo:400:kworker.0 00000100:00100000:3.0:1788361031.586129:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361031.586170:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144057216:0@lo:400:kworker.0 00000100:00100000:3.0:1788361031.586191:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361031.586208:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361031.586213:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144057344:0@lo:400:kworker.0 00000100:00100000:3.0:1788361031.586233:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361031.586262:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144057088 00000100:00100000:3.0:1788361031.586269:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144057088 00000100:00100000:3.0:1788361031.586310:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144057216 00000100:00100000:3.0:1788361031.586314:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144057216 00000100:00100000:3.0:1788361031.586334:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144057344 00000100:00100000:3.0:1788361031.586337:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144057344 00000100:00100000:3.0:1788361031.586351:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361031.586359:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144057088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361031.586410:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144057088:12345-0@lo:400:kworker.0 Request processed in 50us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361031.586428:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361031.586444:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361031.586449:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144057216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361031.586479:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144057216:12345-0@lo:400:kworker.0 Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361031.586485:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361031.586497:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361031.586503:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144057344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361031.586528:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144057344:12345-0@lo:400:kworker.0 Request processed in 25us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361031.586533:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788361031.586554:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788361031.586577:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a90b2f480 x1875232144057344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361031.586589:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144057344:0@lo:400:kworker.0 00010000:00080000:3.0:1788361031.586599:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a90b2c700 x1875232144057216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361031.586606:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144057216:0@lo:400:kworker.0 00010000:00080000:3.0:1788361031.586644:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a90b2d880 x1875232144057088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361031.586652:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144057088:0@lo:400:kworker.0 00000100:00080000:1.0:1788361031.586833:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788361031.586839:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144049536:0@lo:8:kworker.0 00000100:00100000:1.0:1788361031.586864:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144056832:0@lo:8:kworker.0 00000100:00100000:1.0:1788361031.586899:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361031.586924:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144056960:0@lo:8:kworker.0 00000100:00100000:1.0:1788361031.586947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361031.586978:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144056832 00000100:00100000:1.0:1788361031.586982:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144056832 00000100:00100000:1.0:1788361031.586998:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144056960 00000100:00100000:1.0:1788361031.587000:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144056960 00000100:00100000:1.0:1788361031.587011:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361031.587016:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144056832:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788361031.587038:0:14862:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:1.0:1788361031.587064:0:14862:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6611469 00002000:00100000:1.0:1788361031.587078:0:14862:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a8ac1c6b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788361031.587082:0:14862:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788361031.587099:0:14862:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788361031.587492:0:14862:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788361031.587513:0:14862:0:(import.c:65:import_set_state_nolock()) ffff9a8ac1c6f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361031.587555:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144056832:12345-0@lo:8:kworker.0 Request processed in 537us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361031.587563:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361031.587578:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361031.587582:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144056960:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788361031.587597:0:14862:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:1.0:1788361031.587611:0:14862:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6611470 00002000:00100000:1.0:1788361031.587616:0:14862:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a8ac1c6c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788361031.587626:0:14862:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788361031.587629:0:14862:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788361031.587821:0:14862:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788361031.587833:0:14862:0:(import.c:65:import_set_state_nolock()) ffff9a8ac1c6e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361031.587861:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144056960:12345-0@lo:8:kworker.0 Request processed in 278us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361031.587867:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788361031.587916:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a90b2f800 x1875232144056832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361031.587926:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361031.587934:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788361031.587941:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788361031.587947:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788361031.587949:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8aae465800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788361031.587964:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788361031.587969:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144056832:0@lo:8:kworker.0 00010000:00080000:1.0:1788361031.587981:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a90b2c000 x1875232144056960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361031.587988:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361031.587992:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788361031.587995:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788361031.587998:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788361031.588000:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8abf244000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788361031.588018:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788361031.588022:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144056960:0@lo:8:kworker.0 00000004:00080000:2.0:1788361031.588032:0:14250:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788361031.588067:0:14249:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788361031.588109:0:14249:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14249:1875232144057600:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361031.588134:0:14249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361031.588161:0:14249:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88156540 going to sleep for 11 seconds 00000004:00080000:1.0:1788361031.588172:0:14248:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788361031.588199:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144057600 00000100:00100000:1.0:1788361031.588203:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144057600 00000100:00100000:1.0:1788361031.588230:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361031.588236:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14249:x1875232144057600:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788361031.588410:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144056704 00000004:00080000:2.0:1788361031.588413:0:14250:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421603326551ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788361031.588426:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144056704 00000100:00100000:0.0:1788361031.588454:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788361031.588461:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3311:x1875232144056704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361031.588496:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3311:x1875232144056704:12345-0@lo:400:kworker.0 Request processed in 36us (2476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361031.588503:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:3.0:1788361031.590037:0:14251:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788361031.590064:0:14251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14251:1875232144057856:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788361031.590146:0:14251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361031.590181:0:14251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361031.590206:0:14865:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788361031.590212:0:14865:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788361031.590230:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144057728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361031.590254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361031.590272:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361031.590278:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144057472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361031.590296:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361031.590315:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361031.590346:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144056704:0@lo:400:kworker.0 00000100:00100000:3.0:1788361031.590492:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144057856 00000100:00100000:3.0:1788361031.590498:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144057856 00000100:00080000:3.0:1788361031.590534:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361031.590591:0:15711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361031.590600:0:15711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14251:x1875232144057856:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788361031.594665:0:14248:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421609576298ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788361031.594712:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144057728 00000100:00100000:0.0:1788361031.594722:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144057728 00000100:00100000:0.0:1788361031.594755:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144057472 00000100:00100000:0.0:1788361031.594758:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144057472 00000100:00100000:0.0:1788361031.594775:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361031.594783:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144057728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361031.594816:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788361031.594895:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144057728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (4639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361031.594911:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361031.594926:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361031.594931:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144057472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361031.594947:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788361031.594971:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144057472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (4674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361031.594977:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788361031.599263:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ac0877800 x1875232144057472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361031.599290:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144057472:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788361031.602591:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8ac0a51f80 x1875232144057728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361031.602631:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144057728:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1788361031.605730:0:15711:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788361031.605742:0:15711:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788361031.605748:0:15711:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00080000:1.0:1788361031.609739:0:14862:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788361031.609754:0:14862:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788361031.609761:0:14862:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1788361031.624337:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.624349:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d6611477 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624365:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.624370:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.624376:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d6611477 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624393:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d6611477 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624403:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d6611477 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624411:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d6611477 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624429:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.624439:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.624445:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d6611477 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624464:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586a000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.624469:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d6611477 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624479:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d6611477 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624495:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d6611477 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624503:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d6611477 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624518:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.624520:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.624522:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361031.624934:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.624940:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d661147e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624949:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.624952:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.624956:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d661147e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624966:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d661147e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624981:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d661147e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.624988:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d661147e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.625003:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.625011:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.625015:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d661147e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.625022:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586be00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.625026:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d661147e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.625035:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d661147e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.625046:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d661147e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.625054:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d661147e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.625066:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.625073:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.625074:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361031.636359:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.636374:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d6611485 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.636391:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.636395:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.636401:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d6611485 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.639127:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d6611485 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.639161:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d6611485 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.639171:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d6611485 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.639487:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.639502:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.639509:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d6611485 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.639518:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ae00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.639523:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d6611485 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.639545:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d6611485 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.639564:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d6611485 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.639571:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d6611485 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.639592:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.639594:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.639595:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.640003:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.640010:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d661148c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640023:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.640028:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.640033:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d661148c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640047:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d661148c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640055:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d661148c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640063:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d661148c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640111:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.640120:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.640124:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d661148c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361031.640125:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.640131:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d6611493 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640132:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705aa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.640135:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d661148c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.640138:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.640142:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.640143:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d661148c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.640146:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d6611493 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.640172:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d6611493 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640172:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d661148c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640180:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d661148c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.640181:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d6611493 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.640193:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d6611493 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640193:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.640195:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.640197:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.640205:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.640211:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.640214:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d6611493 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.640220:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586a600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.640223:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d6611493 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.640230:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d6611493 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.640241:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d6611493 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.640248:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d6611493 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.640259:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.640261:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.640263:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.640604:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.640610:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d661149a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640618:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.640627:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.640632:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d661149a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640641:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d661149a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640649:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d661149a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640655:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d661149a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640668:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.640675:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.640679:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d661149a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640685:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.640688:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d661149a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640694:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d661149a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640704:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d661149a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640721:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d661149a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.640734:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.640735:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.640737:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.641123:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.641129:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66114a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.641137:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.641140:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.641144:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66114a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361031.643047:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361031.643502:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d66114a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.643524:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1788361031.643529:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361031.643535:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d66114a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.643552:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d66114a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.643562:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d66114a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.643570:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d66114a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.643599:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.644526:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.644544:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d66114a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.644555:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.644560:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d66114a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.644570:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d66114a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.644589:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d66114a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.644597:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d66114a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.644617:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.644619:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.644621:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361031.645195:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361031.645203:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66114af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.645215:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1788361031.645218:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361031.645223:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66114af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.645241:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66114af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.645250:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66114af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.645258:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66114af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.645282:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361031.645909:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361031.645916:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66114b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.645925:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1788361031.645928:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361031.645933:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66114b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.645944:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66114b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.645951:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66114b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.645969:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66114b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.646352:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361031.646443:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66114a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646455:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66114a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646464:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66114a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646480:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361031.646487:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66114af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646504:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.646518:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66114af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646528:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66114af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646548:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66114af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646556:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66114af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646587:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.646591:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66114b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646599:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.646602:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66114b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646610:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66114b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646622:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66114b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646636:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66114b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646650:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.646652:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.646654:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.646673:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.646682:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.646686:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66114a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.646693:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.646696:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66114a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.647200:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66114a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.647216:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66114a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.647223:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66114a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.647245:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.647259:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.647263:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361031.647289:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361031.647296:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fbffc58/0xf6a94c97d66114bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.647306:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1788361031.647310:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361031.647315:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fbffc58/0xf6a94c97d66114bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.647326:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fbffc58/0xf6a94c97d66114bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.647334:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fbffc58/0xf6a94c97d66114bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.647342:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fbffc58/0xf6a94c97d66114bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.647358:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361031.647759:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361031.647765:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66114c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.647778:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1788361031.647781:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361031.647785:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66114c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.647794:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66114c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.647801:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66114c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.647809:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66114c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.647816:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1788361031.647935:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788361031.648010:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361031.648011:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.648018:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66114c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.648026:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.648030:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66114c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.648051:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66114c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.648065:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66114c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.648073:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66114c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.648740:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.648744:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.648747:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.649488:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.649498:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66114cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.650008:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=421s v=(0 0) 00002000:00010000:3.0:1788361031.651056:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.651067:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5f825e1/0xf6a94c97d66114d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.651080:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.651423:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.651432:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5f825e1/0xf6a94c97d66114d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.651448:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5f825e1/0xf6a94c97d66114d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.651460:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5f825e1/0xf6a94c97d66114d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.651478:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5f825e1/0xf6a94c97d66114d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.651496:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.651510:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.651516:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5f825e1/0xf6a94c97d66114d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.651523:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ba00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.651528:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5f825e1/0xf6a94c97d66114d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.651538:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5f825e1/0xf6a94c97d66114d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.651556:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5f825e1/0xf6a94c97d66114d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.651565:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5f825e1/0xf6a94c97d66114d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.651588:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.651591:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.651593:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.652040:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.652049:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66114cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.652062:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66114cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.652070:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66114cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.652077:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66114cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361031.652572:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.652586:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51b127c/0xf6a94c97d66114d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.652596:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.652599:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.652604:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51b127c/0xf6a94c97d66114d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.652616:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51b127c/0xf6a94c97d66114d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.652624:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51b127c/0xf6a94c97d66114d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.652631:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b51b127c/0xf6a94c97d66114d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.652647:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.652796:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.652802:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b51b127c/0xf6a94c97d66114d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.652810:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586b800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.652814:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51b127c/0xf6a94c97d66114d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.652822:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51b127c/0xf6a94c97d66114d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.652843:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b51b127c/0xf6a94c97d66114d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.652851:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51b127c/0xf6a94c97d66114d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.652864:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.652866:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.652867:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361031.654711:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.654722:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d66114e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.654737:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.654741:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.654747:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d66114e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.654759:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d66114e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.654768:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d66114e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.654776:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d66114e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.654815:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361031.654890:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361031.654899:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d66114e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.654909:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586a600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361031.654914:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d66114e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.654924:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d66114e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.654945:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d66114e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.654952:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2a5053/0xf6a94c97d66114e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.654972:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361031.654975:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361031.654983:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361031.655287:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.655294:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d66114e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655303:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.655306:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.655310:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d66114e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655321:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d66114e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655329:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d66114e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655337:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d66114e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655350:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.655358:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.655362:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d66114e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655369:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586ae00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.655378:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d66114e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655386:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d66114e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655397:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d66114e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655405:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a86df5f/0xf6a94c97d66114e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655417:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.655419:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.655420:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.655454:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.655465:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fbffc58/0xf6a94c97d66114bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.655473:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.655476:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fbffc58/0xf6a94c97d66114bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.655495:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fbffc58/0xf6a94c97d66114bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.655646:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fbffc58/0xf6a94c97d66114bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.655656:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fbffc58/0xf6a94c97d66114bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361031.655854:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.655855:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.655858:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.655859:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.655860:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d66114ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.655865:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.655866:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.655868:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.655871:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.655875:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d66114ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.655884:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.655885:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d66114ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655892:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d66114ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655904:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d66114ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655916:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361031.655924:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361031.655928:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66114cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655936:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705aa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.655939:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66114cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655947:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66114cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655961:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66114cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655968:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66114cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.655984:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.655988:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d66114ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.656005:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586be00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.656008:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d66114ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.656015:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d66114ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.656024:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.656028:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d66114ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.656036:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000736a52de/0xf6a94c97d66114ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.656049:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.656051:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.656053:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361031.656520:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.656527:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d66114f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.656535:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.656538:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.656542:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d66114f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.656551:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d66114f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.656565:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d66114f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.656572:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d66114f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.656595:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361031.656623:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361031.656630:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d66114f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.656639:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586a000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.656643:0:15712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d66114f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.656651:0:15712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d66114f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361031.656654:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.656661:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d66114fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.656679:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d66114f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.656683:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.656691:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361031.656695:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c899e39/0xf6a94c97d66114f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.656698:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d66114fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.656717:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.656720:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.656728:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.656891:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d66114fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.656911:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d66114fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.656918:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d66114fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361031.656973:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.656979:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611503 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.656986:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.656989:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.656994:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.657002:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.657009:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.657010:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.657018:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361031.658380:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.658390:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d661150a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.658403:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.658407:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.658413:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d661150a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.658427:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d661150a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.658437:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d661150a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.658445:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d661150a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.658476:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788361031.658488:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361031.658494:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d66114fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.658502:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.658507:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d66114fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.658509:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361031.658520:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611503 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.658522:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d66114fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.658542:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.658547:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611503 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.658551:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d66114fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.658563:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611503 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.658566:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d66114fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.658584:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611503 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.658608:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361031.658612:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d661150a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.658612:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.658616:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.658620:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.658637:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.658641:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d661150a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.658648:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d661150a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.658663:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d661150a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.658670:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d661150a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.659202:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.659205:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.659209:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.660002:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361031.660011:0:15711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ba9f352/0xf6a94c97d6611503 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.660053:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361031.660800:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.660808:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611518 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.660822:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.660826:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.660832:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.660845:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.660855:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.660862:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.660885:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361031.661644:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:1.0:1788361031.661663:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.661783:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661151f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661794:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.661798:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.661803:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661151f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661814:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661151f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661823:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661151f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661831:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661151f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661850:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361031.661853:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d6611511 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661861:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361031.661861:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.661867:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.661869:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.661874:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d6611511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661876:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.661880:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.661884:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d6611511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661889:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.661891:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d6611511 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.661899:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d6611511 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661910:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611518 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.661910:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.661914:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661151f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661919:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611518 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.661921:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.661924:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661151f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.661931:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661151f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.661934:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.661935:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.661937:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.661941:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661151f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361031.662515:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.662523:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6611526 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.662532:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.662536:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.662540:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6611526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.662551:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6611526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.662559:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6611526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.662568:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6611526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.662593:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.662602:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.662608:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6611526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.662615:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.662619:0:15712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6611526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.662627:0:15712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6611526 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.662639:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6611526 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.662646:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6611526 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.662791:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.662794:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.662796:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.662906:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661151f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.662920:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.662922:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.662923:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.662947:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.662958:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.662963:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d6611511 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.662970:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.662974:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d6611511 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.662982:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d6611511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.662994:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d6611511 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.663001:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d6611511 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.663437:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.663446:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.663449:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361031.663779:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.663788:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661152d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.663800:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.663812:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.663817:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661152d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.663829:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661152d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.663838:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661152d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.663846:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661152d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.663861:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.663871:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.663875:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661152d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.663882:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.663886:0:15712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661152d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.663894:0:15712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661152d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.663906:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661152d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.663925:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661152d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.663939:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.663942:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.663944:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.664448:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.664455:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611534 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664465:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.664468:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00002000:00010000:3.0:1788361031.664471:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.664472:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.664476:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d661153b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664483:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.664484:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.664487:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.664491:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d661153b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664493:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611534 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664501:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.664503:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d661153b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.664511:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d661153b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.664517:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d661153b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664517:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.664526:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361031.664530:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.664531:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664538:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.664542:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664560:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664585:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611534 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664593:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611534 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664615:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.664618:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d661153b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664624:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.664627:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d661153b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664634:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d661153b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664645:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d661153b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664652:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d661153b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.664689:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.664692:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.664694:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.664702:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361031.665424:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.665438:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611542 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.665447:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.665450:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.665454:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.665463:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.665471:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.665479:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.665494:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.665503:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.665507:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.665514:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.665518:0:15712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.665526:0:15712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.665544:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611542 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.665550:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009402165c/0xf6a94c97d6611542 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.665563:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.665565:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.665567:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361031.666170:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.666177:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6611549 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.666186:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.666189:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.666193:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6611549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.666203:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6611549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.666211:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6611549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.666218:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6611549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.666244:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361031.666263:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361031.666271:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6611549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666281:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.666285:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6611549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666295:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6611549 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666319:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6611549 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666328:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6611549 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666349:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.666352:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.666355:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.666469:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.666474:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008cf5019/0xf6a94c97d6611550 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.666481:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.666484:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.666488:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008cf5019/0xf6a94c97d6611550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.666498:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008cf5019/0xf6a94c97d6611550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.666506:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008cf5019/0xf6a94c97d6611550 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.666513:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008cf5019/0xf6a94c97d6611550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.666536:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361031.666613:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361031.666617:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.666619:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6611557 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666625:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008cf5019/0xf6a94c97d6611550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.666631:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.666638:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361031.666642:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.666645:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6611557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666647:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008cf5019/0xf6a94c97d6611550 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666662:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008cf5019/0xf6a94c97d6611550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666673:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008cf5019/0xf6a94c97d6611550 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666680:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008cf5019/0xf6a94c97d6611550 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.666710:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.666713:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.666716:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.666792:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6611557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.666801:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6611557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.666807:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6611557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.666826:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361031.667238:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.667246:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661155e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667255:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.667264:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.667269:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661155e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667279:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661155e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667287:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661155e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667293:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661155e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667308:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361031.667318:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361031.667323:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6611557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667330:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.667333:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6611557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667341:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6611557 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667352:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6611557 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667369:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6611557 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667384:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.667387:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661155e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667394:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.667397:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661155e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667405:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661155e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667415:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661155e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667423:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661155e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667433:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.667435:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.667436:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361031.667959:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.667965:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6611565 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.667983:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.667986:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361031.667991:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6611565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668000:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6611565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668008:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6611565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668016:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6611565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668032:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.668041:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.668045:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6611565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668052:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.668055:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6611565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668063:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6611565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668104:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6611565 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668112:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6611565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668127:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.668128:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.668131:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.668421:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.668427:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d661156c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.668444:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.668447:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.668452:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d661156c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.668463:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d661156c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.668470:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d661156c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.668478:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d661156c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.668493:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.668503:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.668507:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d661156c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.668514:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.668517:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d661156c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.668525:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d661156c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361031.668530:0:15711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361031.668535:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6611573 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668543:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788361031.668545:0:15711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.668545:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d661156c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668550:0:15711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6611573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.668553:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d661156c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668559:0:15711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6611573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.668565:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.668566:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6611573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.668567:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.668568:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.668573:0:15711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6611573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668595:0:15711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361031.668602:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361031.668606:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6611573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668613:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361031.668616:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6611573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668624:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6611573 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668634:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6611573 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668641:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6611573 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361031.668787:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.668792:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361031.668794:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788361031.668989:0:15711:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788361031.669392:0:15711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14251:x1875232144057856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 78487us (78939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361031.669402:0:15711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361031.669459:0:14251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14251:1875232144057856:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788361031.669472:0:14251:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788361031.669515:0:14251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14251:1875232144057984:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788361031.669551:0:14251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361031.669592:0:14251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361031.669607:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144057984 00000100:00100000:3.0:1788361031.669612:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144057984 00000100:00100000:3.0:1788361031.669648:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361031.669793:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14251:x1875232144057984:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788361031.669832:0:14865:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1788361031.670133:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.671210:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.671220:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7768286/0xf6a94c97d661157a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.671235:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.671239:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.671245:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7768286/0xf6a94c97d661157a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.671258:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7768286/0xf6a94c97d661157a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.671268:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7768286/0xf6a94c97d661157a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.671276:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7768286/0xf6a94c97d661157a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.671311:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361031.671437:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361031.671445:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7768286/0xf6a94c97d661157a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.671456:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.671460:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7768286/0xf6a94c97d661157a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.671470:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7768286/0xf6a94c97d661157a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.671520:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7768286/0xf6a94c97d661157a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.671529:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7768286/0xf6a94c97d661157a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.671552:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.671554:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.671558:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.672247:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.672255:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d6611581 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.672265:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.672269:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.672273:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d6611581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.672282:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d6611581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.672291:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d6611581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.672298:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d6611581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.672314:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.672324:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.672329:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d6611581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.672337:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.672347:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d6611581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.672355:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d6611581 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.672366:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d6611581 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.672373:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ebc9621/0xf6a94c97d6611581 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.672386:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.672388:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.672389:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.673162:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.673169:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611588 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.673179:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.673182:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.673186:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.673196:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.673205:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.673218:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.673236:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.673247:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.673251:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.673258:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.673262:0:15712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.673270:0:15712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.673281:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611588 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.673288:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c900d790/0xf6a94c97d6611588 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.673301:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.673303:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.673305:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.674171:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.674185:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d661158f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.674194:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.674198:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.674203:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d661158f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.674213:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d661158f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.674221:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d661158f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.674228:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d661158f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.674246:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.674257:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.674262:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d661158f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.674269:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.674273:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d661158f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.674282:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d661158f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.674305:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d661158f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.674312:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095b9b8f6/0xf6a94c97d661158f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.674326:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.674327:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.674329:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.675142:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.675250:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f27f334/0xf6a94c97d6611596 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.675263:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.675267:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.675272:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f27f334/0xf6a94c97d6611596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.675282:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f27f334/0xf6a94c97d6611596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.675290:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f27f334/0xf6a94c97d6611596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.675297:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f27f334/0xf6a94c97d6611596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.675324:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.675335:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.675340:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f27f334/0xf6a94c97d6611596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.675346:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.675350:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f27f334/0xf6a94c97d6611596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.675358:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f27f334/0xf6a94c97d6611596 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.675371:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f27f334/0xf6a94c97d6611596 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.675378:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f27f334/0xf6a94c97d6611596 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.675394:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.675396:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.675398:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361031.675935:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14251:x1875232144057984:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6273us (6378us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788361031.675947:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361031.675999:0:14251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14251:1875232144057984:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788361031.676014:0:14251:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00002000:00010000:1.0:1788361031.676508:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.676517:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec748b64/0xf6a94c97d661159d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.676529:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.676538:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.676543:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec748b64/0xf6a94c97d661159d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.676557:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec748b64/0xf6a94c97d661159d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.676566:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec748b64/0xf6a94c97d661159d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.676649:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec748b64/0xf6a94c97d661159d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.676847:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.676861:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.676867:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec748b64/0xf6a94c97d661159d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.676876:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705a000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.676881:0:15712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec748b64/0xf6a94c97d661159d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.676890:0:15712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec748b64/0xf6a94c97d661159d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.676905:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec748b64/0xf6a94c97d661159d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.676925:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec748b64/0xf6a94c97d661159d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.677006:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.677009:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.677010:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.677522:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.677529:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f030a0c/0xf6a94c97d66115a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.677539:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.677543:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.677547:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f030a0c/0xf6a94c97d66115a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.677558:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f030a0c/0xf6a94c97d66115a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.677566:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f030a0c/0xf6a94c97d66115a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.677573:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f030a0c/0xf6a94c97d66115a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.677863:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.677876:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.677887:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f030a0c/0xf6a94c97d66115a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.677894:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ac00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.677897:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f030a0c/0xf6a94c97d66115a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.677904:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f030a0c/0xf6a94c97d66115a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.677916:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f030a0c/0xf6a94c97d66115a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.677923:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f030a0c/0xf6a94c97d66115a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.678111:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.678113:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.678115:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.678772:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.678780:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66115ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.678849:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.678853:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.678857:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66115ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.678879:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66115ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.678887:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66115ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.678894:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66115ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.678912:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.678923:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.678928:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66115ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.678935:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.679005:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66115ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.679068:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66115ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.679083:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66115ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.679119:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001925d925/0xf6a94c97d66115ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.679140:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.679142:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.679144:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.679972:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.679980:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66115b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.679992:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.679996:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.680001:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66115b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.680279:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66115b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.680290:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66115b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.680298:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66115b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.680335:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361031.680846:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361031.680854:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66115b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.680870:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705aa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.680874:0:15712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66115b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.680883:0:15712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66115b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.680903:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66115b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.680910:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd0b1c24/0xf6a94c97d66115b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.680936:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.680938:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.680940:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.681261:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.681268:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d66115b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.681287:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.681290:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.681295:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d66115b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.681306:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d66115b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.681315:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d66115b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.681323:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d66115b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.681345:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361031.681366:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361031.681373:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d66115b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.681383:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.681387:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d66115b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.681396:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d66115b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.681426:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d66115b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.681434:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d66115b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.681450:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.681453:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.681456:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.682225:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.682234:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d66115c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.682246:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.682249:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.682254:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d66115c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.682263:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d66115c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.682281:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d66115c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.682288:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d66115c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.682311:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361031.682484:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361031.682491:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d66115c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.682501:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.682505:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d66115c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.682513:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d66115c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.682529:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d66115c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.682536:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d66115c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.682567:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.682569:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.682571:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361031.683060:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.683067:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ac8ca6f/0xf6a94c97d66115c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.683076:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.683079:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.683116:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ac8ca6f/0xf6a94c97d66115c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.683128:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ac8ca6f/0xf6a94c97d66115c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.683137:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ac8ca6f/0xf6a94c97d66115c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.683145:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ac8ca6f/0xf6a94c97d66115c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.683197:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361031.683207:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.683212:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ac8ca6f/0xf6a94c97d66115c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.683220:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.683224:0:15712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ac8ca6f/0xf6a94c97d66115c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.683233:0:15712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ac8ca6f/0xf6a94c97d66115c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.683246:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ac8ca6f/0xf6a94c97d66115c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.683254:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ac8ca6f/0xf6a94c97d66115c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.683268:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.683270:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.683272:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788361031.683594:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788361031.684164:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.684172:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d66115ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.684183:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.684192:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.684196:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d66115ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.684208:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d66115ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.684219:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d66115ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.684226:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d66115ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.684284:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361031.685004:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.685011:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fdeeac4/0xf6a94c97d66115d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.685032:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.685036:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.685040:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fdeeac4/0xf6a94c97d66115d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.685050:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fdeeac4/0xf6a94c97d66115d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.685058:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fdeeac4/0xf6a94c97d66115d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.685071:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fdeeac4/0xf6a94c97d66115d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.685404:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361031.685413:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d66115ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.685422:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.685427:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d66115ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.685435:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d66115ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.685452:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d66115ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.685460:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d66115ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.685480:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361031.685484:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fdeeac4/0xf6a94c97d66115d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.685490:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.685500:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fdeeac4/0xf6a94c97d66115d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.685507:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fdeeac4/0xf6a94c97d66115d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.685517:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fdeeac4/0xf6a94c97d66115d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.685524:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.685526:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.685528:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.685670:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361031.685676:0:14862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fdeeac4/0xf6a94c97d66115d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361031.686215:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361031.686222:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b77dcc5/0xf6a94c97d66115dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.686231:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788361031.686235:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361031.686240:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b77dcc5/0xf6a94c97d66115dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.686251:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b77dcc5/0xf6a94c97d66115dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.686259:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b77dcc5/0xf6a94c97d66115dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.686266:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b77dcc5/0xf6a94c97d66115dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.687408:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361031.687417:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b77dcc5/0xf6a94c97d66115dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.687427:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.687432:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b77dcc5/0xf6a94c97d66115dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.687440:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b77dcc5/0xf6a94c97d66115dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.687456:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b77dcc5/0xf6a94c97d66115dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.687674:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361031.687678:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361031.687680:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.687794:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361031.687801:0:14862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b77dcc5/0xf6a94c97d66115dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.688247:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361031.688604:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361031.688612:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a01993f/0xf6a94c97d66115e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.688625:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1788361031.688630:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361031.688635:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a01993f/0xf6a94c97d66115e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.688660:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a01993f/0xf6a94c97d66115e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.688672:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a01993f/0xf6a94c97d66115e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.688680:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a01993f/0xf6a94c97d66115e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.688704:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361031.689129:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361031.689136:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000957b2221/0xf6a94c97d66115ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.689145:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1788361031.689163:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361031.689168:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000957b2221/0xf6a94c97d66115ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.689179:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000957b2221/0xf6a94c97d66115ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.689189:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000957b2221/0xf6a94c97d66115ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.689194:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000957b2221/0xf6a94c97d66115ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.689210:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361031.689290:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361031.689297:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a01993f/0xf6a94c97d66115e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.689307:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.689312:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a01993f/0xf6a94c97d66115e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.689323:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a01993f/0xf6a94c97d66115e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.689340:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a01993f/0xf6a94c97d66115e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.689349:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a01993f/0xf6a94c97d66115e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.689369:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361031.689373:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000957b2221/0xf6a94c97d66115ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.689392:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361031.689396:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000957b2221/0xf6a94c97d66115ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.689406:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000957b2221/0xf6a94c97d66115ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.689417:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000957b2221/0xf6a94c97d66115ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.689426:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000957b2221/0xf6a94c97d66115ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361031.689438:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.689440:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361031.689441:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.689535:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361031.694180:0:14862:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361031.694192:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007eee179/0xf6a94c97d66115f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.694210:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1788361031.694215:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361031.694221:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007eee179/0xf6a94c97d66115f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.694235:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007eee179/0xf6a94c97d66115f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.694246:0:14862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007eee179/0xf6a94c97d66115f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.694264:0:14862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007eee179/0xf6a94c97d66115f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361031.694356:0:14862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361031.694382:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361031.694390:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007eee179/0xf6a94c97d66115f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.694398:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361031.694403:0:15712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007eee179/0xf6a94c97d66115f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.694413:0:15712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007eee179/0xf6a94c97d66115f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.694441:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007eee179/0xf6a94c97d66115f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.694447:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007eee179/0xf6a94c97d66115f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361031.694465:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.694467:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361031.694469:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788361031.694722:0:14862:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1788361031.695016:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14249:x1875232144057600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 106775us (106876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361031.695030:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361031.695176:0:14249:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14249:1875232144057600:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788361031.695195:0:14249:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788361031.695243:0:14249:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14249:1875232144058112:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361031.695294:0:14249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361031.695325:0:14249:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361031.695391:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144058112 00000100:00100000:3.0:1788361031.695398:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144058112 00000100:00100000:3.0:1788361031.695445:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361031.695454:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14249:x1875232144058112:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788361031.695491:0:14864:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1788361031.699269:0:14249:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14249:1875232144058112:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788361031.699286:0:14249:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:3.0:1788361031.699801:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14249:x1875232144058112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3694us (3853us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788361031.699814:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788361032.224501:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361033.249964:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788361033.458540:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788361033.458556:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788361033.957167:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788361033.957194:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1788361034.276854:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361034.277162:0:15891:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788361035.302440:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361036.006614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361036.008531:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130439040 00000100:00100000:2.0:1788361036.008545:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130439040 00000100:00100000:2.0:1788361036.008615:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788361036.008624:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1875232130439040:12345-192.168.203.60@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788361036.008652:0:14220:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 959e9e7f-774e-4361-b4b5-5ac0edf42466@192.168.203.60@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:2.0:1788361036.008680:0:14220:0:(genops.c:1406:class_connect()) connect: client 959e9e7f-774e-4361-b4b5-5ac0edf42466, cookie 0xf6a94c97d66115f8 00000100:00080000:2.0:1788361036.008814:0:14220:0:(import.c:65:import_set_state_nolock()) ffff9a8ab76db800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361036.008884:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+5:2348:x1875232130439040:12345-192.168.203.60@tcp:250:mount.lustre.0 Request processed in 259us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361036.008892:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788361036.012634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361036.012712:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130439168 00000100:00100000:3.0:1788361036.012734:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130439168 00000100:00100000:3.0:1788361036.012787:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1788361036.012796:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+5:13679:x1875232130439168:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361036.012812:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361036.012828:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66115ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e5a9 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.012856:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66115ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5a9 expref: 6 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.012866:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66115ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5a9 expref: 6 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.012875:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fa00, rc 0) 00000100:00100000:3.0:1788361036.013013:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+6:13679:x1875232130439168:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 217us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.013020:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1788361036.018688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361036.019179:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130439296 00000100:00100000:0.0:1788361036.019189:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130439296 00000100:00100000:0.0:1788361036.019296:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1788361036.019308:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+6:13679:x1875232130439296:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788361036.019675:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+6:13679:x1875232130439296:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 368us (997us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361036.019684:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1788361036.024240:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361036.025737:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130439424 00000100:00100000:3.0:1788361036.025750:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130439424 00000100:00100000:3.0:1788361036.025819:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:3.0:1788361036.025829:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+6:13679:x1875232130439424:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361036.025849:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361036.025866:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e5b0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.025895:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5b0 expref: 7 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.025923:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5b0 expref: 7 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.025932:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f600, rc 0) 00000100:00100000:3.0:1788361036.026005:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+7:13679:x1875232130439424:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 177us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.026012:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:1.0:1788361036.027969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361036.028076:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130439552 00000100:00100000:0.0:1788361036.028160:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130439552 00000100:00100000:1.0:1788361036.028482:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:1.0:1788361036.028494:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+7:13679:x1875232130439552:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788361036.028782:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+8:13679:x1875232130439552:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 289us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361036.028791:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:0.0:1788361036.030491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361036.030571:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130439680 00000100:00100000:2.0:1788361036.030579:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130439680 00000100:00100000:2.0:1788361036.030622:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:2.0:1788361036.030631:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+8:13679:x1875232130439680:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788361036.030948:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+8:13679:x1875232130439680:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 317us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361036.030957:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1788361036.032962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361036.033143:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130439808 00000100:00100000:1.0:1788361036.033151:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130439808 00000100:00100000:1.0:1788361036.033191:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:1.0:1788361036.033199:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+8:13698:x1875232130439808:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361036.033519:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+8:13698:x1875232130439808:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 320us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361036.033526:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:1.0:1788361036.050238:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361036.050360:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130439936 00000100:00100000:2.0:1788361036.050369:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130439936 00000100:00100000:2.0:1788361036.050458:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788361036.050468:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+8:13698:x1875232130439936:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361036.050743:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+8:13698:x1875232130439936:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 276us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361036.050752:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1788361036.058985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361036.059218:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130440064 00000100:00100000:3.0:1788361036.059229:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130440064 00000100:00100000:3.0:1788361036.059290:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788361036.059300:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+8:13679:x1875232130440064:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361036.059319:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361036.059338:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1ea00/0xf6a94c97d661160d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e5da expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.059368:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1ea00/0xf6a94c97d661160d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5da expref: 9 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.059380:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1ea00/0xf6a94c97d661160d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5da expref: 9 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.059389:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ea00, rc 0) 00000100:00100000:3.0:1788361036.059545:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+9:13679:x1875232130440064:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 245us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.059552:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:0.0:1788361036.065262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361036.065384:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130440192 00000100:00100000:2.0:1788361036.065405:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130440192 00000100:00100000:2.0:1788361036.065512:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:2.0:1788361036.065524:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+9:13679:x1875232130440192:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788361036.065551:0:14220:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788361036.065568:0:14220:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788361036.065572:0:14220:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788361036.065576:0:14220:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788361036.065578:0:14220:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788361036.069149:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+9:13679:x1875232130440192:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 3615us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361036.069167:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1788361036.073173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361036.073432:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130440320 00000100:00100000:1.0:1788361036.073443:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130440320 00000100:00100000:1.0:1788361036.073511:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:1.0:1788361036.073520:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+9:13679:x1875232130440320:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788361036.073539:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361036.073558:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611614 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e5e1 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361036.073601:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5e1 expref: 10 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361036.073612:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5e1 expref: 10 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361036.073621:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c9a00, rc 0) 00000100:00100000:1.0:1788361036.073673:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:13679:x1875232130440320:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 153us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361036.073680:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:0.0:1788361036.076917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361036.078317:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130440448 00000100:00100000:2.0:1788361036.078333:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130440448 00000100:00100000:2.0:1788361036.078484:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:2.0:1788361036.078497:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:13679:x1875232130440448:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788361036.078802:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:13679:x1875232130440448:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 308us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361036.078809:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:0.0:1788361036.080587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361036.080809:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130440576 00000100:00100000:3.0:1788361036.080817:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130440576 00000100:00100000:3.0:1788361036.080871:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788361036.080879:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:13679:x1875232130440576:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788361036.081493:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:13679:x1875232130440576:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 612us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361036.081503:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:2.0:1788361036.087969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361036.088043:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130440704 00000100:00100000:1.0:1788361036.088053:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130440704 00000100:00100000:1.0:1788361036.088145:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:1.0:1788361036.088155:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:13703:x1875232130440704:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361036.088653:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:13703:x1875232130440704:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 273us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361036.088663:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:1.0:1788361036.090457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361036.090713:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130440832 00000100:00100000:2.0:1788361036.090723:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130440832 00000100:00100000:2.0:1788361036.090772:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:2.0:1788361036.090782:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:13703:x1875232130440832:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361036.091011:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:13703:x1875232130440832:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 230us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361036.091019:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:0.0:1788361036.096788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361036.096980:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130440960 00000100:00100000:3.0:1788361036.096991:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130440960 00000100:00100000:3.0:1788361036.097039:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361036.097048:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1875232130440960:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788361036.097077:0:14228:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from b731a8db-84ff-4db6-8c11-a2dda6e4d993@192.168.203.60@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:3.0:1788361036.097179:0:14228:0:(genops.c:1406:class_connect()) connect: client b731a8db-84ff-4db6-8c11-a2dda6e4d993, cookie 0xf6a94c97d661161b 00000004:00100000:3.0:1788361036.097212:0:14228:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788361036.097220:0:14228:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788361036.134899:0:14228:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361036.134999:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:2348:x1875232130440960:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 37949us (38219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.135011:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361036.137731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361036.138168:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130441088 00000100:00100000:3.0:1788361036.138178:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130441088 00000100:00100000:3.0:1788361036.138254:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361036.138265:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:0:x1875232130441088:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788361036.138311:0:14226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788361036.138411:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:0:x1875232130441088:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 147us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.138420:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00080000:0.0:1788361036.138431:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361036.139142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361036.139318:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130441216 00000100:00100000:3.0:1788361036.139323:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130441216 00000100:00100000:3.0:1788361036.139368:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361036.139375:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13679:x1875232130441216:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788361036.139393:0:14228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788361036.139436:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13679:x1875232130441216:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.139442:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788361036.141410:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361036.141475:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130441344 00000100:00100000:1.0:1788361036.141482:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130441344 00000100:00100000:1.0:1788361036.141518:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361036.141524:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13679:x1875232130441344:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788361036.141589:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13679:x1875232130441344:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 66us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361036.141595:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361036.148498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361036.148543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361036.148596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361036.148692:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130441600 00000100:00100000:3.0:1788361036.148697:0:15711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130441472 00000100:00100000:0.0:1788361036.148702:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130441600 00000100:00100000:3.0:1788361036.148705:0:15711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130441472 00000100:00100000:0.0:1788361036.148768:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361036.148778:0:15711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361036.148780:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875232130441600:12345-192.168.203.60@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788361036.148789:0:15711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875232130441472:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361036.148817:0:15711:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from b731a8db-84ff-4db6-8c11-a2dda6e4d993@192.168.203.60@tcp t0 exp 0000000000000000 cur 426 last 0 00010000:00080000:0.0:1788361036.148817:0:14862:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from b731a8db-84ff-4db6-8c11-a2dda6e4d993@192.168.203.60@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1788361036.148854:0:14862:0:(genops.c:1406:class_connect()) connect: client b731a8db-84ff-4db6-8c11-a2dda6e4d993, cookie 0xf6a94c97d6611622 00002000:00100000:0.0:1788361036.148866:0:14862:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b731a8db-84ff-4db6-8c11-a2dda6e4d993/ffff9a8a86759800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788361036.148889:0:14862:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:00000080:3.0:1788361036.148900:0:15711:0:(genops.c:1406:class_connect()) connect: client b731a8db-84ff-4db6-8c11-a2dda6e4d993, cookie 0xf6a94c97d6611629 00002000:00100000:3.0:1788361036.148907:0:15711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b731a8db-84ff-4db6-8c11-a2dda6e4d993/ffff9a8a83e4c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361036.148921:0:15711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788361036.149264:0:14862:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788361036.149294:0:14862:0:(import.c:65:import_set_state_nolock()) ffff9a8a86759000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361036.149360:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:2348:x1875232130441600:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 582us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361036.149369:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00002000:00080000:3.0:1788361036.149483:0:15711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788361036.149500:0:15711:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361036.149538:0:15711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:2348:x1875232130441472:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 750us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.149545:0:15711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788361036.149565:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130441728 00000100:00100000:2.0:1788361036.149571:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130441728 00000100:00100000:2.0:1788361036.149610:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788361036.149618:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13679:x1875232130441728:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788361036.151169:0:14229:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1498us 00000004:00200000:3.0:1788361036.160078:0:14229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788361036.160316:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13679:x1875232130441728:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 10693us (11713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.160332:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361036.315988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361036.316108:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130441856 00000100:00100000:3.0:1788361036.316142:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130441856 00000100:00100000:3.0:1788361036.316201:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361036.316213:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13724:x1875232130441856:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:3.0:1788361036.316245:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361036.317501:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6611630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e60b expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.317577:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611637 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.317591:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.317606:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361036.319514:0:14226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788361036.319523:0:14226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361036.319701:0:14226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.319740:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6611630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e60b expref: 8 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.319759:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e60b expref: 7 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361036.319768:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526800) 00010000:00010000:3.0:1788361036.319771:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361036.319775:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fc00, rc 0) 00000100:00100000:3.0:1788361036.320283:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:13724:x1875232130441856:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 4069us (4301us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361036.320291:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361036.320294:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361036.960293:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144058240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361036.960367:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361036.960440:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144058368:0@lo:400:kworker.0 00000100:00100000:3.0:1788361036.960451:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144058752:0@lo:400:kworker.0 00000100:00100000:0.0:1788361036.960563:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144058240 00000100:00100000:0.0:1788361036.960572:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144058240 00000100:00100000:2.0:1788361036.960666:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144058496:0@lo:400:kworker.0 00000100:00100000:0.0:1788361036.960715:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361036.960724:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144058240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361036.960744:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788361036.960860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361036.960896:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144058624:0@lo:400:kworker.0 00000100:00100000:3.0:1788361036.960921:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361036.960938:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144059136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361036.960958:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361036.960986:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144058752 00000100:00100000:3.0:1788361036.960989:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144058752 00000100:00100000:3.0:1788361036.961017:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361036.961024:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144058752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361036.961062:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144058752:12345-0@lo:400:kworker.0 Request processed in 38us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.961070:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361036.961139:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144058752:0@lo:400:kworker.0 00000100:00100000:3.0:1788361036.961176:0:14866:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788361036.961184:0:14866:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:3.0:1788361036.961196:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361036.961297:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144059136 00000100:00100000:3.0:1788361036.961301:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144059136 00000100:00080000:3.0:1788361036.961322:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361036.961596:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361036.961604:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144059136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361036.961621:0:16006:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788361036.961656:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144059136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.961663:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361036.961685:0:3312:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788361036.961701:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144059136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361036.961733:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144058624 00000100:00100000:3.0:1788361036.961737:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144058624 00000100:00100000:3.0:1788361036.961765:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361036.961772:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144058624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361036.961779:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361036.961822:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144058880:0@lo:400:kworker.0 00000100:00100000:3.0:1788361036.961823:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144058624:12345-0@lo:400:kworker.0 Request processed in 48us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.961835:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361036.961865:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361036.961866:0:3312:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788361036.961880:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144058624:0@lo:400:kworker.0 00000100:00100000:1.0:1788361036.961902:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144058368 00000100:00100000:1.0:1788361036.961907:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144058368 00000100:00100000:3.0:1788361036.961911:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144058880 00000100:00100000:3.0:1788361036.961916:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144058880 00000100:00100000:1.0:1788361036.961942:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788361036.961953:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3314:x1875232144058368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361036.961957:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361036.961968:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144058880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361036.962001:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3314:x1875232144058368:12345-0@lo:400:kworker.0 Request processed in 51us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361036.962009:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788361036.962015:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144058880:12345-0@lo:400:kworker.0 Request processed in 47us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.962022:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788361036.962036:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361036.962285:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144058368:0@lo:400:kworker.0 00000100:00100000:1.0:1788361036.962296:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144058880:0@lo:400:kworker.0 00000100:00100000:2.0:1788361036.962834:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361036.962868:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144059008:0@lo:400:kworker.0 00000100:00100000:2.0:1788361036.962895:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361036.962927:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144059008 00000100:00100000:2.0:1788361036.962932:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144059008 00000100:00100000:2.0:1788361036.962966:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361036.962972:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144059008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361036.963012:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144059008:12345-0@lo:400:kworker.0 Request processed in 40us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361036.963017:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788361036.963034:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361036.963054:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144059008:0@lo:400:kworker.0 00000100:00100000:3.0:1788361036.963327:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144058496 00000100:00100000:3.0:1788361036.963332:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144058496 00000100:00100000:3.0:1788361036.963365:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361036.963392:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144058496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361036.963444:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144058496:12345-0@lo:400:kworker.0 Request processed in 54us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361036.963566:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361036.963747:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144058496:0@lo:400:kworker.0 00000100:00100000:0.0:1788361036.963983:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144058240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3259us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361036.963992:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361036.965193:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144058240:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788361037.345741:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361038.153240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361038.153339:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130441984 00000100:00100000:3.0:1788361038.153350:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130441984 00000100:00100000:3.0:1788361038.153433:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361038.153444:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:13776:x1875232130441984:12345-192.168.203.60@tcp:41:lfs.0 00000004:00000024:3.0:1788361038.153488:0:14228:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788361038.153581:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:13776:x1875232130441984:12345-192.168.203.60@tcp:41:lfs.0 Request processed in 140us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361038.153588:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:2.0:1788361038.153801:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361038.157333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361038.157428:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130442112 00000100:00100000:3.0:1788361038.157438:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130442112 00000100:00100000:3.0:1788361038.157514:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361038.157525:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13776:x1875232130442112:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:3.0:1788361038.157564:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788361038.157746:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361038.157784:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13776:x1875232130442112:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 260us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361038.157791:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361038.160817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361038.160914:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130442240 00000100:00100000:0.0:1788361038.160923:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130442240 00000100:00100000:0.0:1788361038.161005:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361038.161014:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13776:x1875232130442240:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:0.0:1788361038.161050:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788361038.161179:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:13776:x1875232130442240:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 166us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361038.161186:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00080000:2.0:1788361038.161250:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361038.318995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361038.319135:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130442368 00000100:00100000:2.0:1788361038.319147:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130442368 00000100:00100000:2.0:1788361038.319205:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:2.0:1788361038.319215:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:13810:x1875232130442368:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788361038.319248:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361038.319267:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d661163e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e612 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361038.319296:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d661163e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e612 expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361038.319307:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d661163e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e612 expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361038.319315:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:2.0:1788361038.319372:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13810:x1875232130442368:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 158us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.319379:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788361038.322427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361038.322768:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130442496 00000100:00100000:2.0:1788361038.322779:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130442496 00000100:00100000:2.0:1788361038.322833:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788361038.322842:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13810:x1875232130442496:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788361038.323193:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13810:x1875232130442496:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 350us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.323201:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1788361038.332051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361038.332370:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130442624 00000100:00100000:3.0:1788361038.332381:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130442624 00000100:00100000:3.0:1788361038.332443:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:3.0:1788361038.332453:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13810:x1875232130442624:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788361038.332733:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13810:x1875232130442624:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 280us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361038.332742:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:3.0:1788361038.336531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361038.336969:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130442752 00000100:00100000:1.0:1788361038.336980:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130442752 00000100:00100000:1.0:1788361038.337034:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1788361038.337043:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13816:x1875232130442752:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361038.338497:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13816:x1875232130442752:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 1446us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361038.338513:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1788361038.356227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361038.356489:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130442880 00000100:00100000:2.0:1788361038.356499:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130442880 00000100:00100000:2.0:1788361038.356590:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:2.0:1788361038.356601:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13816:x1875232130442880:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361038.356905:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13816:x1875232130442880:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 304us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.356920:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:0.0:1788361038.359567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361038.360162:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130443008 00000100:00100000:1.0:1788361038.360173:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130443008 00000100:00100000:1.0:1788361038.360229:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361038.360239:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13810:x1875232130443008:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788361038.360256:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361038.360275:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ac06c9000/0xf6a94c97d6611645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e63c expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361038.360303:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ac06c9000/0xf6a94c97d6611645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e63c expref: 12 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361038.360316:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ac06c9000/0xf6a94c97d6611645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e63c expref: 12 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361038.360325:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c9000, rc 0) 00000100:00100000:1.0:1788361038.360392:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:13810:x1875232130443008:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 154us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361038.360399:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361038.367207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361038.367354:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130443136 00000100:00100000:2.0:1788361038.367368:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130443136 00000100:00100000:2.0:1788361038.367465:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:2.0:1788361038.367475:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:13810:x1875232130443136:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788361038.367503:0:14220:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788361038.367524:0:14220:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788361038.367540:0:14220:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788361038.367543:0:14220:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788361038.367546:0:14220:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00010000:00010000:3.0:1788361038.368503:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361038.375826:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:13810:x1875232130443136:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 8339us (8617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.375843:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:0.0:1788361038.383971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361038.384082:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130443264 00000100:00100000:3.0:1788361038.384126:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130443264 00000100:00100000:3.0:1788361038.384262:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:3.0:1788361038.384272:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:13810:x1875232130443264:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361038.384292:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361038.384310:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d661164c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e643 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361038.384341:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d661164c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e643 expref: 13 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361038.384353:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d661164c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e643 expref: 13 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361038.384364:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e000, rc 0) 00000100:00100000:3.0:1788361038.384425:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13810:x1875232130443264:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 154us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361038.384432:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:1.0:1788361038.388372:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361038.388456:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130443392 00000100:00100000:2.0:1788361038.388466:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130443392 00000100:00100000:2.0:1788361038.388513:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:2.0:1788361038.388522:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13810:x1875232130443392:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788361038.390784:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13810:x1875232130443392:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 2251us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.390799:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:0.0:1788361038.393481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361038.393570:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130443520 00000100:00100000:3.0:1788361038.393581:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130443520 00000100:00100000:3.0:1788361038.394060:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:3.0:1788361038.394071:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13810:x1875232130443520:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788361038.394394:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13810:x1875232130443520:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 323us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361038.394402:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:0.0:1788361038.399307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361038.399372:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130443648 00000100:00100000:2.0:1788361038.399381:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130443648 00000100:00100000:2.0:1788361038.399425:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:2.0:1788361038.399433:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13821:x1875232130443648:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361038.399674:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13821:x1875232130443648:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 240us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.399688:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:2.0:1788361038.402322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361038.402439:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130443776 00000100:00100000:3.0:1788361038.402449:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130443776 00000100:00100000:3.0:1788361038.402503:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:3.0:1788361038.402513:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13821:x1875232130443776:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788361038.402829:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13821:x1875232130443776:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 313us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361038.402838:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:0.0:1788361038.408477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361038.409297:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130443904 00000100:00100000:2.0:1788361038.409309:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130443904 00000100:00100000:2.0:1788361038.409363:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1788361038.409372:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875232130443904:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788361038.409401:0:14226:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 6a6c7f1e-7137-478a-bebd-d5781dcb5c03@192.168.203.60@tcp t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:2.0:1788361038.409442:0:14226:0:(genops.c:1406:class_connect()) connect: client 6a6c7f1e-7137-478a-bebd-d5781dcb5c03, cookie 0xf6a94c97d6611653 00000004:00100000:2.0:1788361038.409474:0:14226:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788361038.409604:0:14226:0:(import.c:65:import_set_state_nolock()) ffff9a8ab6fbf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361038.409682:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2348:x1875232130443904:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 309us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.409690:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1788361038.412396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361038.412699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361038.413051:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130444032 00000100:00100000:2.0:1788361038.413060:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130444032 00000100:00100000:2.0:1788361038.413203:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130444160 00000100:00100000:2.0:1788361038.413207:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130444160 00000100:00100000:2.0:1788361038.413227:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788361038.413237:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+7:0:x1875232130444032:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788361038.413271:0:14227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788361038.413346:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+7:0:x1875232130444032:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 110us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.413353:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788361038.413371:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788361038.413377:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:13810:x1875232130444160:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788361038.413407:0:14227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788361038.413445:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:13810:x1875232130444160:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 67us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.413451:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00080000:0.0:1788361038.413611:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361038.415703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361038.415782:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130444288 00000100:00100000:3.0:1788361038.415791:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130444288 00000100:00100000:3.0:1788361038.415846:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361038.415854:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:13810:x1875232130444288:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788361038.415932:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:13810:x1875232130444288:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361038.415939:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361038.420560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361038.422328:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130444416 00000100:00100000:3.0:1788361038.422345:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130444416 00000100:00100000:3.0:1788361038.422425:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361038.422434:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875232130444416:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361038.422467:0:14862:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 6a6c7f1e-7137-478a-bebd-d5781dcb5c03@192.168.203.60@tcp t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:3.0:1788361038.422502:0:14862:0:(genops.c:1406:class_connect()) connect: client 6a6c7f1e-7137-478a-bebd-d5781dcb5c03, cookie 0xf6a94c97d661165a 00002000:00100000:3.0:1788361038.422513:0:14862:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6a6c7f1e-7137-478a-bebd-d5781dcb5c03/ffff9a8a83e48800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361038.422537:0:14862:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361038.422664:0:14862:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788361038.422711:0:14862:0:(import.c:65:import_set_state_nolock()) ffff9a8a8438e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361038.422855:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2348:x1875232130444416:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 418us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.422868:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361038.423524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361038.423843:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130444544 00000100:00100000:3.0:1788361038.423851:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130444544 00000100:00100000:3.0:1788361038.423888:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361038.423894:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875232130444544:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361038.423918:0:14864:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 6a6c7f1e-7137-478a-bebd-d5781dcb5c03@192.168.203.60@tcp t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:3.0:1788361038.423942:0:14864:0:(genops.c:1406:class_connect()) connect: client 6a6c7f1e-7137-478a-bebd-d5781dcb5c03, cookie 0xf6a94c97d6611661 00002000:00100000:3.0:1788361038.423951:0:14864:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6a6c7f1e-7137-478a-bebd-d5781dcb5c03/ffff9a8a8438d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361038.423959:0:14864:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361038.424046:0:14864:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788361038.424070:0:14864:0:(import.c:65:import_set_state_nolock()) ffff9a8a84389000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361038.424149:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2348:x1875232130444544:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 252us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361038.424155:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361038.426352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361038.427068:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130444672 00000100:00100000:1.0:1788361038.427078:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130444672 00000100:00100000:1.0:1788361038.427171:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:1.0:1788361038.427180:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:13810:x1875232130444672:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788361038.427661:0:14230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788361038.427822:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:13810:x1875232130444672:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 641us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361038.427830:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000001:00100000:2.0:1788361038.535516:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a6c7f1e-7137-478a-bebd-d5781dcb5c03 00000001:00100000:2.0:1788361038.535531:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b731a8db-84ff-4db6-8c11-a2dda6e4d993 00000100:00100000:0.0:1788361038.582739:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361038.582869:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130444800 00000100:00100000:2.0:1788361038.582880:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130444800 00000100:00100000:2.0:1788361038.583006:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361038.583018:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:13842:x1875232130444800:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:2.0:1788361038.583039:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361038.583060:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6611668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e66d expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361038.583226:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361038.583247:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361038.583261:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361038.583545:0:14226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361038.583556:0:14226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361038.583671:0:14226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361038.583700:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6611668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e66d expref: 8 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361038.583718:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e66d expref: 7 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361038.583727:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526800) 00010000:00010000:2.0:1788361038.583730:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361038.583734:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:2.0:1788361038.583802:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+7:13842:x1875232130444800:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 786us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361038.583809:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000001:00100000:0.0:1788361039.069351:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b731a8db-84ff-4db6-8c11-a2dda6e4d993 00000001:00100000:0.0:1788361039.069369:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a6c7f1e-7137-478a-bebd-d5781dcb5c03 00010000:00010000:3.0:1788361039.393313:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361039.777445:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788361040.418824:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361040.509984:0:16099:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788361041.440235:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788361041.635242:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a6c7f1e-7137-478a-bebd-d5781dcb5c03 00000001:00100000:0.0:1788361041.635272:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b731a8db-84ff-4db6-8c11-a2dda6e4d993 00000100:00100000:1.0:1788361042.083176:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144059264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361042.083253:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361042.083315:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361042.083322:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144059392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361042.083342:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361042.083405:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144059264 00000100:00100000:1.0:1788361042.083412:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144059264 00000100:00100000:1.0:1788361042.083456:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144059392 00000100:00100000:1.0:1788361042.083459:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144059392 00000100:00100000:1.0:1788361042.083473:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361042.083480:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144059264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361042.083519:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788361042.083558:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144059264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361042.083565:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361042.083587:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361042.083593:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144059392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361042.083609:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788361042.083634:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144059392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361042.083639:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361042.083675:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144059392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361042.083686:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144059264:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788361042.084210:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361042.084216:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361042.084319:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144059520:0@lo:400:kworker.0 00000100:00100000:0.0:1788361042.084322:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144059648:0@lo:400:kworker.0 00000100:00100000:2.0:1788361042.087019:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144059904:0@lo:400:kworker.0 00000100:00100000:0.0:1788361042.087402:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361042.087526:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361042.087532:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361042.087558:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361042.087566:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144059776:0@lo:400:kworker.0 00000100:00100000:2.0:1788361042.087595:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361042.087608:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144059648 00000100:00100000:1.0:1788361042.087617:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144059648 00000100:00100000:2.0:1788361042.087618:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144059904 00000100:00100000:2.0:1788361042.087620:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144059904 00000100:00100000:1.0:1788361042.087715:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144059776 00000100:00100000:1.0:1788361042.087719:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144059776 00000100:00100000:3.0:1788361042.087732:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361042.087743:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144059648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361042.087826:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144059648:12345-0@lo:400:kworker.0 Request processed in 58us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361042.087833:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361042.087833:0:14227:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788361042.087840:0:14227:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1788361042.087860:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361042.087862:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788361042.087868:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144059776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361042.087909:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144059776:12345-0@lo:400:kworker.0 Request processed in 41us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361042.087919:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361042.088554:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144059776:0@lo:400:kworker.0 00000100:00100000:2.0:1788361042.089678:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788361042.089690:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144059904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361042.089766:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144059904:12345-0@lo:400:kworker.0 Request processed in 80us (2232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361042.089781:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788361042.089824:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144059904:0@lo:400:kworker.0 00000100:00100000:0.0:1788361042.089909:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144059520 00000100:00100000:0.0:1788361042.089916:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144059520 00000100:00100000:0.0:1788361042.089953:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788361042.089960:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3311:x1875232144059520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361042.090009:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3311:x1875232144059520:12345-0@lo:400:kworker.0 Request processed in 50us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361042.090015:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788361042.090159:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144059520:0@lo:400:kworker.0 00000100:00100000:0.0:1788361042.090194:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144059648:0@lo:400:kworker.0 00010000:00010000:3.0:1788361042.465569:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361043.268210:0:16249:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1846fb20 20000000:00000080:2.0:1788361043.268231:0:16249:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8985a84000 uarg=0000000000000000 20000000:01000000:2.0:1788361043.268272:0:16249:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788361043.268279:0:16249:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788361043.268284:0:16249:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788361043.268849:0:16250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788361043.269306:0:16249:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788361043.274740:0:16249:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788361043.274774:0:16249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.274793:0:16249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d661136d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611366 expref: 18 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.274800:0:16249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a898586b200/0xf6a94c97d66113ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66113b3 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.274807:0:16249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661142a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611423 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.274817:0:16249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5e1 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.274824:0:16249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d661164c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e643 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.274831:0:16249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.274885:0:16249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d661164c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e643 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.274899:0:16249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d661164c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e643 expref: 12 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361043.274915:0:16249:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16249:1875232144060032:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361043.275127:0:16249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5e1 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.275135:0:16249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611614 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5e1 expref: 12 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361043.275144:0:16249:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16249:1875232144060160:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361043.275179:0:16249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661142a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6611423 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.275188:0:16249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661142a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6611423 expref: 18 pid: 14220 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361043.275198:0:16249:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16249:1875232144060288:0@lo:104: 00000100:00100000:2.0:1788361043.275240:0:16249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361043.275276:0:16249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a898586b200/0xf6a94c97d66113ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66113b3 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.275284:0:16249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a898586b200/0xf6a94c97d66113ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66113b3 expref: 18 pid: 14220 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361043.275304:0:16249:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16249:1875232144060416:0@lo:104: 00000100:00100000:2.0:1788361043.275326:0:16249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361043.275361:0:16249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d661136d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6611366 expref: 18 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.275370:0:16249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d661136d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6611366 expref: 18 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361043.275378:0:16249:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84854380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16249:1875232144060544:0@lo:104: 00000100:00100000:2.0:1788361043.275408:0:16249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361043.275417:0:16249:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361043.275500:0:14210:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788361043.275514:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144060288 00000100:00100000:0.0:1788361043.275520:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144060288 00000100:00100000:0.0:1788361043.275555:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144060416 00000100:00100000:0.0:1788361043.275558:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144060416 00000100:00100000:0.0:1788361043.275567:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144060544 00000100:00100000:0.0:1788361043.275569:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144060544 00000100:00100000:0.0:1788361043.275582:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361043.275589:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+5:16249:x1875232144060288:12345-0@lo:104: 00010000:00010000:0.0:1788361043.275603:0:14210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.275672:0:14210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361043.275678:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+5:16249:x1875232144060288:12345-0@lo:104: Request processed in 90us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.275685:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361043.275702:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361043.275708:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+4:16249:x1875232144060416:12345-0@lo:104: 00010000:00010000:0.0:1788361043.275716:0:14210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.275748:0:14210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788361043.275760:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+4:16249:x1875232144060416:12345-0@lo:104: Request processed in 52us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.275766:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361043.275777:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361043.275783:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f0e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+3:16249:x1875232144060544:12345-0@lo:104: 00010000:00010000:0.0:1788361043.275790:0:14210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.275823:0:14210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788361043.275827:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f0e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+3:16249:x1875232144060544:12345-0@lo:104: Request processed in 45us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.275832:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788361043.275874:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788361043.275881:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.275889:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586b400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361043.275893:0:15712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.275901:0:15712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361043.275908:0:15712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361043.275913:0:15712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361043.275939:0:15712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.275955:0:15712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361043.275974:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.275981:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586b400/0xf6a94c97d6611423 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661142a expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.275994:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361043.275997:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276004:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45a00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361043.276008:0:15712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276014:0:15712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361043.276020:0:15712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361043.276025:0:15712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361043.276038:0:15712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276043:0:15712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361043.276048:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276054:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b45a00/0xf6a94c97d66113b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66113ba expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276082:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361043.276108:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276114:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705be00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361043.276117:0:15712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276124:0:15712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361043.276129:0:15712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361043.276134:0:15712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361043.276149:0:15712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276154:0:15712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361043.276174:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276181:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab705be00/0xf6a94c97d6611366 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661136d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276194:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361043.276197:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361043.276199:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361043.276205:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361043.276217:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361043.276235:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144060672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361043.276266:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361043.276296:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361043.276302:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144060800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361043.276322:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361043.276347:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361043.276354:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144060928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361043.276377:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361043.276399:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144060672 00000100:00100000:0.0:1788361043.276403:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144060672 00010000:00010000:0.0:1788361043.276420:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661142a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611423 expref: 19 pid: 14220 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361043.276432:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144060800 00000100:00100000:0.0:1788361043.276435:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144060800 00010000:00010000:0.0:1788361043.276446:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a898586b200/0xf6a94c97d66113ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66113b3 expref: 20 pid: 14220 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361043.276455:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144060928 00000100:00100000:0.0:1788361043.276458:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144060928 00010000:00010000:0.0:1788361043.276466:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d661136d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611366 expref: 21 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361043.276478:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361043.276484:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b97d369-4bf1-43ee-a977-45b88f10e003+21:3311:x1875232144060672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361043.276493:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361043.276499:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661142a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611423 expref: 21 pid: 14220 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276518:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661142a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6611423 expref: 21 pid: 14220 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276534:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361043.276566:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b97d369-4bf1-43ee-a977-45b88f10e003+21:3311:x1875232144060672:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.276573:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361043.276586:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361043.276592:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b97d369-4bf1-43ee-a977-45b88f10e003+20:3311:x1875232144060800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361043.276599:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361043.276603:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a898586b200/0xf6a94c97d66113ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66113b3 expref: 20 pid: 14220 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276611:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a898586b200/0xf6a94c97d66113ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66113b3 expref: 20 pid: 14220 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276619:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361043.276640:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b97d369-4bf1-43ee-a977-45b88f10e003+20:3311:x1875232144060800:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.276645:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361043.276656:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361043.276661:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8927cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3314:x1875232144060928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361043.276668:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361043.276671:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d661136d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611366 expref: 19 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276678:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d661136d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6611366 expref: 19 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.276693:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361043.276719:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8927cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3314:x1875232144060928:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.276725:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361043.276778:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144060928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361043.276802:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144060800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361043.276809:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144060672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361043.281493:0:16249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586bc00/0xf6a94c97d661142a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6611423 expref: 18 pid: 14220 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361043.281511:0:16249:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16249:1875232144060288:0@lo:104: 00010000:00010000:2.0:1788361043.281524:0:16249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586b200/0xf6a94c97d66113ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66113b3 expref: 17 pid: 14220 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361043.281531:0:16249:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16249:1875232144060416:0@lo:104: 00010000:00010000:2.0:1788361043.281541:0:16249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8c42200/0xf6a94c97d661136d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6611366 expref: 16 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361043.281549:0:16249:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84854380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16249:1875232144060544:0@lo:104: 00000100:00100000:2.0:1788361043.283565:0:16249:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16249:1875232144060032:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361043.284328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361043.284404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361043.284507:0:16249:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16249:1875232144060160:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361043.284546:0:16249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361043.284844:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130444928 00000100:00100000:1.0:1788361043.284851:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130444928 00000100:00100000:0.0:1788361043.284883:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130445056 00010000:00010000:1.0:1788361043.284886:0:14212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d661164c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e643 expref: 13 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361043.284890:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130445056 00010000:00010000:0.0:1788361043.284915:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611614 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5e1 expref: 14 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361043.284936:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361043.284946:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:959e9e7f-774e-4361-b4b5-5ac0edf42466+14:2349:x1875232130444928:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361043.284963:0:14212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361043.284968:0:14211:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788361043.284980:0:14212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d661164c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e643 expref: 14 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361043.284982:0:14211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788361043.284997:0:14212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d661164c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e643 expref: 14 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361043.285015:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d661164c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e643 expref: 14 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361043.285542:0:14212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361043.285603:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:2349:x1875232130444928:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 656us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.286823:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361043.286840:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:2349:x1875232130445056:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361043.286854:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361043.286862:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611614 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5e1 expref: 13 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.286886:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5e1 expref: 13 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.286904:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611614 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5e1 expref: 13 pid: 14218 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.286967:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.286997:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.287017:0:14213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.287025:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.287033:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.287040:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.287047:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361043.287051:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.287060:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.287111:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.287123:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361043.288004:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:2349:x1875232130445056:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1161us (3590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.288017:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361043.291027:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:2.0:1788361043.293185:0:16249:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.293202:0:16249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361043.293209:0:16249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611676 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361043.488407:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361043.597521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361043.597572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361043.597664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361043.597737:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130445184 00000100:00100000:2.0:1788361043.597747:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130445184 00000100:00100000:2.0:1788361043.597872:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361043.597891:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:2351:x1875232130445184:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361043.597969:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:2351:x1875232130445184:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361043.597977:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00080000:1.0:1788361043.599711:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361043.601131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361043.601829:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130445440 00000100:00100000:3.0:1788361043.601840:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130445440 00000100:00100000:3.0:1788361043.601972:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130445312 00000100:00100000:3.0:1788361043.601976:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130445312 00000100:00080000:1.0:1788361043.602000:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361043.602004:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361043.602041:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:1.0:1788361043.602054:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2351:x1875232130445440:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361043.602157:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2351:x1875232130445440:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 106us (4584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361043.602165:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1788361043.604363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361043.604393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361043.604422:0:15711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130445696 00000100:00100000:0.0:1788361043.604430:0:15711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130445696 00000100:00100000:2.0:1788361043.604511:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130445824 00000100:00100000:2.0:1788361043.604516:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130445824 00000100:00100000:0.0:1788361043.604755:0:15711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788361043.604765:0:15711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2351:x1875232130445696:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361043.604817:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361043.604827:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2352:x1875232130445312:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361043.604833:0:15711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2351:x1875232130445696:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 69us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.604842:0:15711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1788361043.604865:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2352:x1875232130445312:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (7200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.604867:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130445568 00000100:00100000:0.0:1788361043.604873:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130445568 00000100:00100000:3.0:1788361043.604877:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361043.604919:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361043.604927:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2352:x1875232130445568:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361043.604958:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2352:x1875232130445568:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361043.604965:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361043.605273:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361043.605281:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2352:x1875232130445824:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361043.605324:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2352:x1875232130445824:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 43us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361043.605331:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00080000:1.0:1788361043.606030:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361043.606036:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361043.606039:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1788361044.322831:0:14223:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788361044.322838:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a8a10b000 from 10 10000000:01000000:2.0:1788361044.322850:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788361044.322894:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361044.322906:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361044.322917:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361044.322944:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361044.323023:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361044.323677:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144061056 00000100:00100000:3.0:1788361044.323685:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144061056 00000100:00100000:3.0:1788361044.323731:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788361044.323739:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+16:14223:x1875232144061056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361044.323752:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361044.323767:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6611684 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661167d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361044.323791:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6611684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661167d expref: 17 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361044.323815:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6611684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661167d expref: 17 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361044.323824:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:3.0:1788361044.323867:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+17:14223:x1875232144061056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361044.323875:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788361044.324004:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361044.324140:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361044.324157:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361044.324168:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361044.324236:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361044.324269:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361044.324292:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361044.324308:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144061184 00000100:00100000:2.0:1788361044.324312:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144061184 00000100:00100000:2.0:1788361044.324334:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788361044.324342:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+18:14223:x1875232144061184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361044.324603:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0663050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+17:14223:x1875232144061184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361044.324617:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788361044.324651:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361044.324679:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361044.324734:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361044.324752:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361044.324764:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144061312 00000100:00100000:2.0:1788361044.324768:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144061312 00000100:00100000:2.0:1788361044.324790:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788361044.324796:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+17:14223:x1875232144061312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361044.324924:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0661450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+17:14223:x1875232144061312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361044.324931:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788361044.324978:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361044.325822:0:16303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788361044.326110:0:14223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788361044.326131:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361044.326141:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.326160:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361044.326169:0:14223:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788361044.326172:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a9efc3000 from 10 10000000:01000000:1.0:1788361044.326174:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361044.326201:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.326208:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.326218:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361044.326236:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.326349:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361044.326378:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361044.327138:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144061440 00000100:00100000:1.0:1788361044.327145:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144061440 00000100:00100000:1.0:1788361044.327185:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788361044.327193:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+17:14223:x1875232144061440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361044.327207:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361044.327219:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611692 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661168b expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.327242:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661168b expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.327839:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661168b expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.327851:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c8600, rc 0) 00000100:00100000:1.0:1788361044.327905:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0663850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:14223:x1875232144061440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 711us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361044.327912:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788361044.327969:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361044.327984:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.327992:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361044.328049:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.328106:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361044.328123:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361044.328136:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144061568 00000100:00100000:1.0:1788361044.328140:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144061568 00000100:00100000:1.0:1788361044.328162:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788361044.328168:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:14223:x1875232144061568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.328990:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0661050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:14223:x1875232144061568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 820us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361044.328999:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788361044.329041:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.329111:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.329148:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361044.329164:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857abd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361044.329176:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144061696 00000100:00100000:1.0:1788361044.329180:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144061696 00000100:00100000:1.0:1788361044.329221:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788361044.329228:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:14223:x1875232144061696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.329971:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0662450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:14223:x1875232144061696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 740us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361044.329979:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788361044.330027:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361044.330685:0:16305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788361044.330730:0:14223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788361044.330745:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361044.330753:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.330763:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361044.331885:0:14223:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788361044.331890:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a89871ae800 from 10 10000000:01000000:1.0:1788361044.331895:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361044.331930:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.331939:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.331955:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361044.331975:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.332025:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361044.332048:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361044.332079:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144061824 00000100:00100000:1.0:1788361044.332098:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144061824 00000100:00100000:1.0:1788361044.332136:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788361044.332144:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:14223:x1875232144061824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361044.332157:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361044.332169:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ac06c8400/0xf6a94c97d66116a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611699 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.332191:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ac06c8400/0xf6a94c97d66116a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611699 expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.332202:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ac06c8400/0xf6a94c97d66116a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611699 expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.332210:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c8400, rc 0) 00000100:00100000:1.0:1788361044.332245:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:14223:x1875232144061824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361044.332251:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788361044.332296:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361044.332310:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.332325:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361044.332370:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.332395:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361044.332408:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361044.332419:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144061952 00000100:00100000:1.0:1788361044.332422:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144061952 00000100:00100000:1.0:1788361044.332442:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788361044.332448:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:14223:x1875232144061952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.332670:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:14223:x1875232144061952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361044.332678:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788361044.332708:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144061952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.332734:0:14223:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144062080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.333639:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361044.333672:0:14223:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361044.333688:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144062080 00000100:00100000:1.0:1788361044.333693:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144062080 00000100:00100000:1.0:1788361044.333724:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788361044.333731:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:14223:x1875232144062080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361044.333918:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:14223:x1875232144062080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361044.333925:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788361044.333975:0:14223:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b97d369-4bf1-43ee-a977-45b88f10e003:14223:1875232144062080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361044.335340:0:16306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788361044.335481:0:14223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788361044.335499:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361044.335510:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361044.335521:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361044.514435:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361045.193558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361045.193869:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130445952 00000100:00100000:2.0:1788361045.193878:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130445952 00000100:00100000:2.0:1788361045.193934:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:2.0:1788361045.193944:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:13693:x1875232130445952:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361045.193959:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361045.193976:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66116a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e674 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.194004:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66116a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e674 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.194034:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66116a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e674 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.194043:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:2.0:1788361045.194134:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:13693:x1875232130445952:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 191us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361045.194141:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:3.0:1788361045.204744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361045.204816:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130446080 00000100:00100000:1.0:1788361045.204826:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130446080 00000100:00100000:1.0:1788361045.204882:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:1.0:1788361045.204892:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:13693:x1875232130446080:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361045.205252:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0660c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:13693:x1875232130446080:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 360us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361045.205261:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:3.0:1788361045.210778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361045.210880:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130446208 00000100:00100000:1.0:1788361045.210892:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130446208 00000100:00100000:2.0:1788361045.211216:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:2.0:1788361045.211230:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:13693:x1875232130446208:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361045.211583:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:13693:x1875232130446208:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 355us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361045.211591:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:0.0:1788361045.221315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361045.221442:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130446336 00000100:00100000:2.0:1788361045.221452:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130446336 00000100:00100000:2.0:1788361045.221512:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:2.0:1788361045.221522:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:13693:x1875232130446336:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361045.221538:0:14218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361045.221554:0:14218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d66116ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e67b expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.221583:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d66116ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e67b expref: 13 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.221593:0:14218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d66116ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e67b expref: 13 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.221620:0:14218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fc00, rc 0) 00000100:00100000:2.0:1788361045.221681:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13693:x1875232130446336:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 161us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361045.221688:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:3.0:1788361045.223456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361045.223612:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130446464 00000100:00100000:2.0:1788361045.223621:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130446464 00000100:00100000:2.0:1788361045.223673:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:2.0:1788361045.223681:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13693:x1875232130446464:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361045.223961:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13693:x1875232130446464:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 279us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361045.223970:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:3.0:1788361045.225327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361045.225460:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130446592 00000100:00100000:2.0:1788361045.225469:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130446592 00000100:00100000:2.0:1788361045.225517:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:2.0:1788361045.225524:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13693:x1875232130446592:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361045.225770:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:13693:x1875232130446592:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 244us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361045.225778:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00010000:00010000:0.0:1788361045.536716:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361045.952857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361045.952951:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130446720 00000100:00100000:2.0:1788361045.952960:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130446720 00000100:00100000:2.0:1788361045.953036:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361045.953047:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:14353:x1875232130446720:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361045.953080:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361045.953137:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66116b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e682 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953211:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66116bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953225:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66116bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953237:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66116bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953249:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66116c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953257:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66116c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953263:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66116c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953658:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66116ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953668:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66116ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953675:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66116ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361045.953744:0:14226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788361045.953748:0:14226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361045.953824:0:14226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66116ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953845:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66116bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953850:0:14226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66116bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953856:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66116bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953862:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361045.953866:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66116bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953875:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66116bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953887:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526800) 00010000:00010000:2.0:1788361045.953890:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361045.953894:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66116bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953901:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66116bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953912:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66116c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953917:0:14226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66116c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953923:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66116c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953933:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361045.953936:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66116c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953942:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66116c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953949:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788361045.953951:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361045.953954:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66116c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953959:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66116c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.953989:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66116b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e682 expref: 8 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.954001:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66116ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e682 expref: 7 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361045.954008:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:2.0:1788361045.954011:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361045.954033:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e000, rc 0) 00000100:00100000:2.0:1788361045.954137:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:14353:x1875232130446720:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1093us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361045.954145:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00080000:1.0:1788361045.954217:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361045.958617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361045.963253:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130446976 00000100:00100000:0.0:1788361045.963270:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130446976 00000100:00100000:0.0:1788361045.963809:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361045.963836:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:14353:x1875232130446976:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361045.963856:0:16168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361045.963881:0:16168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66116d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e689 expref: -99 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.963961:0:16168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66116d8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.963977:0:16168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66116d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.963991:0:16168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66116d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.964063:0:16168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66116df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.964072:0:16168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66116df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.964079:0:16168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66116df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.964897:0:16168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66116e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.964910:0:16168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66116e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.964919:0:16168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66116e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361045.964940:0:16168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788361045.968780:0:16168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66116d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968797:0:16168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66116d8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968805:0:16168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66116d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968812:0:16168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361045.968816:0:16168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66116d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968825:0:16168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66116d8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968842:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:0.0:1788361045.968845:0:16168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361045.968850:0:16168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66116d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968856:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66116d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968871:0:16168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66116df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968877:0:16168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66116df lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968901:0:16168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66116df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968907:0:16168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361045.968910:0:16168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66116df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968916:0:16168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66116df lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968924:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a983bfe00) 00010000:00010000:0.0:1788361045.968927:0:16168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361045.968929:0:16168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66116df lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.968934:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66116df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.970925:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66116d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e689 expref: 10 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.970953:0:16168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66116e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e689 expref: 9 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361045.970961:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a983bf600) 00010000:00010000:0.0:1788361045.970964:0:16168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361045.970967:0:16168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42c00, rc 0) 00000100:00100000:0.0:1788361045.971046:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:14353:x1875232130446976:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 7212us (12447us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788361045.971818:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361045.976605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361045.976886:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130447104 00000100:00100000:2.0:1788361045.976908:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130447104 00000100:00100000:2.0:1788361045.976966:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1788361045.976977:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:14353:x1875232130447104:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788361045.977119:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:14353:x1875232130447104:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 143us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361045.977128:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361045.999336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361045.999903:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130447232 00000100:00100000:3.0:1788361045.999912:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130447232 00000100:00100000:3.0:1788361046.000016:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361046.000027:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:14359:x1875232130447232:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361046.000047:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361046.000078:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d66116f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e690 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000182:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66116fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000197:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66116fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000210:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66116fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000238:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611702 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000246:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000253:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000504:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66116fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000513:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66116fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000520:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66116fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000526:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361046.000529:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66116fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000538:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66116fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000550:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526800) 00010000:00010000:3.0:1788361046.000553:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361046.000558:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66116fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000564:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66116fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000594:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000600:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611702 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000606:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611702 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000611:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361046.000613:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611702 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000619:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611702 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000627:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a8a99526400) 00010000:00010000:3.0:1788361046.000630:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361046.000632:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611702 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000638:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611702 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000669:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d66116f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e690 expref: 10 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000678:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526800) 00010000:00010000:3.0:1788361046.000681:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361046.000691:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d66116f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e690 expref: 10 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.000701:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f800, rc 0) 00000100:00100000:3.0:1788361046.000755:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:14359:x1875232130447232:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 730us (1437us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361046.000762:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361046.010152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361046.011936:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130447360 00000100:00100000:1.0:1788361046.011951:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130447360 00000100:00100000:1.0:1788361046.012024:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361046.012034:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:14359:x1875232130447360:12345-192.168.203.60@tcp:700:lfs.0 00000100:00100000:1.0:1788361046.012179:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:14359:x1875232130447360:12345-192.168.203.60@tcp:700:lfs.0 Request processed in 145us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361046.012206:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361046.016583:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.016674:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130447616 00000100:00100000:2.0:1788361046.016684:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130447616 00000100:00100000:2.0:1788361046.016740:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:2.0:1788361046.016750:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:14359:x1875232130447616:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:2.0:1788361046.016805:0:14226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361046.016831:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611637 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e60b expref: 9 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.016849:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526800) 00010000:00010000:2.0:1788361046.016854:0:14226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361046.017186:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.017201:0:14226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e66d expref: 5 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.017210:0:14226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.017242:0:14226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e66d expref: 5 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.017267:0:14226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e66d expref: 5 pid: 14226 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.017282:0:14226:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14226:1875232144062208:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361046.017393:0:14226:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361046.019334:0:14226:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14226:1875232144062208:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361046.019364:0:14226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361046.020535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361046.020603:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130447744 00000100:00100000:0.0:1788361046.020612:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130447744 00010000:00010000:0.0:1788361046.020664:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e66d expref: 6 pid: 14226 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361046.020757:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361046.020767:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2350:x1875232130447744:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361046.020783:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361046.020791:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e66d expref: 6 pid: 14226 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.020803:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e66d expref: 6 pid: 14226 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.020824:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661166f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e66d expref: 6 pid: 14226 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.020840:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526800) 00010000:00010000:0.0:1788361046.020845:0:14213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.020855:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.020863:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.020904:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1788361046.020914:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361046.020971:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2350:x1875232130447744:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 204us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361046.020978:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00010000:00010000:3.0:1788361046.021729:0:14226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.021751:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.021777:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.021789:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.021798:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361046.023492:0:14226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788361046.023508:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.023518:0:14226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.023524:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.023530:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361046.023534:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.023542:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.023556:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526800) 00010000:00010000:2.0:1788361046.023559:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361046.023571:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.023577:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611709 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361046.023596:0:14226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045039d1b reply state 00000000acea7780 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.023606:0:14226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361046.023709:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+10:14359:x1875232130447616:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 6957us (7142us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788361046.023718:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00010000:00010000:0.0:1788361046.025831:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.025847:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.025854:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.025860:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361046.025863:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.025870:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.025887:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a8a99526400) 00010000:00010000:0.0:1788361046.025890:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361046.025895:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.025901:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611710 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361046.085046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361046.085248:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130447872 00000100:00100000:0.0:1788361046.085258:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130447872 00000100:00100000:0.0:1788361046.085408:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:0.0:1788361046.085419:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:14367:x1875232130447872:12345-192.168.203.60@tcp:101:lctl.0 00010000:00010000:0.0:1788361046.085444:0:16168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361046.085466:0:16168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6611717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e697 expref: -99 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.085532:0:16168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d661171e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.085546:0:16168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d661171e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.085558:0:16168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d661171e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361046.085619:0:16168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361046.085624:0:16168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361046.085666:0:16168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d661171e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.085772:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d6611717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e697 expref: 11 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.085792:0:16168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d661171e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e697 expref: 10 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.085801:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:0.0:1788361046.085803:0:16168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361046.085807:0:16168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42e00, rc 0) 00000100:00100000:0.0:1788361046.085918:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+10:14367:x1875232130447872:12345-192.168.203.60@tcp:101:lctl.0 Request processed in 501us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361046.085934:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788361046.104922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.105013:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130448000 00000100:00100000:3.0:1788361046.105023:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130448000 00000100:00100000:3.0:1788361046.105166:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:3.0:1788361046.105177:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:14368:x1875232130448000:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361046.105199:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361046.105218:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e69e expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.105296:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661172c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.105310:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661172c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.105322:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661172c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361046.105380:0:14227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788361046.105384:0:14227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361046.105408:0:14227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661172c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.105432:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e69e expref: 7 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.105450:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661172c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e69e expref: 6 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.105458:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:3.0:1788361046.105461:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361046.105465:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f000, rc 0) 00000100:00100000:3.0:1788361046.105527:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:14368:x1875232130448000:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 351us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361046.105534:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361046.110184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.110414:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130448128 00000100:00100000:3.0:1788361046.110426:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130448128 00000100:00100000:3.0:1788361046.110541:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361046.110552:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:14368:x1875232130448128:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361046.110573:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361046.110592:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6611733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6a5 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.110658:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661173a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.110826:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661173a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.110843:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661173a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.110860:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6611741 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.110868:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6611741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.110875:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6611741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111017:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611748 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111027:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111034:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361046.111117:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788361046.111122:0:14228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361046.111146:0:14228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611748 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111159:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661173a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111166:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661173a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111172:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661173a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111177:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361046.111182:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661173a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111189:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661173a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111201:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:3.0:1788361046.111204:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361046.111208:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661173a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111213:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d661173a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111227:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6611741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111243:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6611741 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111249:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6611741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111254:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361046.111257:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6611741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111264:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6611741 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111273:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a8a99526500) 00010000:00010000:3.0:1788361046.111275:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361046.111278:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6611741 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111283:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d6611741 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111313:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d6611733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6a5 expref: 8 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111402:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611748 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6a5 expref: 7 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.111411:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a8a99526600) 00010000:00010000:3.0:1788361046.111414:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361046.111422:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f800, rc 0) 00000100:00100000:3.0:1788361046.111483:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+7:14368:x1875232130448128:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 933us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361046.115492:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788361046.119627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.120037:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130448384 00000100:00100000:3.0:1788361046.120063:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130448384 00000100:00100000:3.0:1788361046.120476:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788361046.120489:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+7:14368:x1875232130448384:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361046.120513:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361046.120534:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661174f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6ac expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361046.120656:0:14227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788361046.120804:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661174f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ac expref: 9 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.120822:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:3.0:1788361046.120825:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361046.120831:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661174f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ac expref: 9 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.120845:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f400, rc 0) 00000100:00100000:3.0:1788361046.120908:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+8:14368:x1875232130448384:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 421us (1291us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788361046.120925:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1788361046.126374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361046.126473:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130448640 00000100:00100000:0.0:1788361046.126483:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130448640 00000100:00100000:0.0:1788361046.126543:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361046.126553:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+8:14368:x1875232130448640:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:0.0:1788361046.126609:0:16168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361046.126635:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6611748 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6a5 expref: 8 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.126653:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a8a99526600) 00010000:00010000:0.0:1788361046.126664:0:16168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361046.126701:0:16168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.126713:0:16168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.126724:0:16168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361046.126947:0:16168:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e46fed44 reply state 00000000c18b0328 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361046.126957:0:16168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788361046.126973:0:16168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1788361046.127408:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+9:14368:x1875232130448640:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 854us (1041us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788361046.127416:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00010000:00010000:0.0:1788361046.132718:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.132736:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.132743:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.132749:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361046.132754:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.132762:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.132779:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a8a983bf000) 00010000:00010000:0.0:1788361046.132782:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788361046.132787:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.132793:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d661175d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361046.134318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.134552:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130448896 00000100:00100000:3.0:1788361046.134564:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130448896 00000100:00100000:3.0:1788361046.134633:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361046.134654:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+8:14368:x1875232130448896:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361046.134897:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+9:14368:x1875232130448896:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 245us (628us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788361046.134905:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:1.0:1788361046.138192:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.138291:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130449152 00000100:00100000:2.0:1788361046.138301:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130449152 00000100:00100000:2.0:1788361046.138363:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:2.0:1788361046.138373:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+9:14368:x1875232130449152:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361046.138396:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361046.138416:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6b3 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138487:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661176b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138501:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661176b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138512:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661176b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138525:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6611772 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138545:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6611772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138552:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6611772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361046.138685:0:14226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788361046.138777:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661176b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138785:0:14226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661176b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138792:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661176b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138798:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361046.138802:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661176b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138810:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661176b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138822:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:2.0:1788361046.138825:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361046.138830:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661176b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138836:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661176b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138862:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6611772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138868:0:14226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6611772 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138874:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6611772 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138879:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361046.138882:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6611772 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138888:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6611772 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138896:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788361046.138899:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361046.138901:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6611772 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138907:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6611772 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138942:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611764 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6b3 expref: 11 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138952:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:2.0:1788361046.138954:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361046.138964:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6b3 expref: 11 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.138973:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:2.0:1788361046.139035:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+10:14368:x1875232130449152:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 664us (853us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788361046.139043:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361046.141173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.141266:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130449280 00000100:00100000:2.0:1788361046.141276:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130449280 00000100:00100000:2.0:1788361046.141336:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1788361046.141345:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+10:14368:x1875232130449280:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361046.141369:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361046.141390:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611780 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6ba expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.141465:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.141478:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.141489:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361046.141535:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788361046.141539:0:14228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361046.141558:0:14228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.141582:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611780 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ba expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.141612:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ba expref: 11 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.141620:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a8aa8ee1200) 00010000:00010000:2.0:1788361046.141623:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361046.141626:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ea00, rc 0) 00000100:00100000:2.0:1788361046.141683:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+11:14368:x1875232130449280:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 339us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361046.141691:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:1.0:1788361046.147171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361046.147286:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130449408 00000100:00100000:0.0:1788361046.147297:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130449408 00000100:00100000:0.0:1788361046.147380:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788361046.147390:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+11:14368:x1875232130449408:12345-192.168.203.60@tcp:37:lfs.0 00000100:00100000:0.0:1788361046.151072:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+11:14368:x1875232130449408:12345-192.168.203.60@tcp:37:lfs.0 Request processed in 3673us (3900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361046.151120:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1788361046.160442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.161142:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130449664 00000100:00100000:3.0:1788361046.161155:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130449664 00000100:00100000:3.0:1788361046.161205:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361046.161216:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9ea4a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+11:14368:x1875232130449664:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361046.161676:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9ea4a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+12:14368:x1875232130449664:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 461us (1242us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788361046.161684:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361046.198694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.198920:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130449792 00000100:00100000:2.0:1788361046.198930:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130449792 00000100:00100000:2.0:1788361046.198987:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1788361046.198996:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+10:14374:x1875232130449792:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361046.199016:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361046.199035:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661178e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6c1 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199219:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611795 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199234:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611795 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199244:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611795 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199258:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661179c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199287:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661179c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199295:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661179c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199404:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66117a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199412:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66117a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199418:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66117a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361046.199446:0:14226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788361046.199450:0:14226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361046.199483:0:14226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66117a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199495:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611795 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199501:0:14226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611795 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199508:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611795 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199514:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361046.199517:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611795 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199530:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611795 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199542:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:2.0:1788361046.199545:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361046.199549:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199555:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199566:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661179c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199571:0:14226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661179c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199577:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661179c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199582:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361046.199585:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661179c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199596:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661179c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199602:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788361046.199604:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361046.199607:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661179c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199621:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661179c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199647:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661178e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c1 expref: 12 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199660:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66117a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c1 expref: 11 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.199667:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a8aa8ee1200) 00010000:00010000:2.0:1788361046.199669:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788361046.199671:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f400, rc 0) 00000100:00100000:2.0:1788361046.199779:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:14374:x1875232130449792:12345-192.168.203.60@tcp:101:bash.0 Request processed in 782us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361046.199786:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1788361046.203030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361046.203381:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130450048 00000100:00100000:0.0:1788361046.203391:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130450048 00000100:00100000:0.0:1788361046.203480:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361046.203490:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:14374:x1875232130450048:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788361046.203510:0:16168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361046.203528:0:16168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66117aa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6c8 expref: -99 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.203713:0:16168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.203728:0:16168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ba expref: 11 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.203737:0:16168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.203769:0:16168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ba expref: 11 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.203782:0:16168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ba expref: 11 pid: 14228 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361046.203796:0:16168:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16168:1875232144062336:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361046.203933:0:16168:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361046.207183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.207668:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130450176 00000100:00100000:2.0:1788361046.207676:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130450176 00010000:00010000:2.0:1788361046.207713:0:14211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ba expref: 12 pid: 14228 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.207754:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1788361046.207763:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+12:2350:x1875232130450176:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361046.207776:0:14211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361046.207783:0:14211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ba expref: 12 pid: 14228 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.207814:0:14211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ba expref: 12 pid: 14228 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.207836:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a8aa8ee1200) 00010000:00010000:2.0:1788361046.207841:0:14211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.207851:0:14211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.207858:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.207876:0:14211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361046.207932:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+12:2350:x1875232130450176:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 170us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361046.207940:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00010000:00010000:0.0:1788361046.208793:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6611787 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6ba expref: 11 pid: 14228 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361046.208812:0:16168:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16168:1875232144062336:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361046.208840:0:16168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.208855:0:16168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.208861:0:16168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.208884:0:16168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.208899:0:16168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.208909:0:16168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212285:0:16168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212304:0:16168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212316:0:16168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361046.212327:0:16168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788361046.212355:0:16168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212363:0:16168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212382:0:16168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212398:0:16168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361046.212403:0:16168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212410:0:16168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212423:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a8aa8ee1200) 00010000:00010000:0.0:1788361046.212427:0:16168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361046.212430:0:16168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212436:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43e00/0xf6a94c97d66117b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361046.212450:0:16168:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012cabb39 reply state 00000000363c2a1e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361046.212460:0:16168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361046.212495:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43200/0xf6a94c97d66117aa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c8 expref: 14 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212510:0:16168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c8 expref: 13 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.212518:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:0.0:1788361046.212526:0:16168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788361046.212529:0:16168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8c42800, rc 0) 00000100:00100000:0.0:1788361046.212678:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:14374:x1875232130450048:12345-192.168.203.60@tcp:101:bash.0 Request processed in 9189us (9655us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788361046.212688:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00010000:00010000:0.0:1788361046.215708:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.215726:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.215735:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.215741:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361046.215745:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.215753:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.215768:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a8a983bf000) 00010000:00010000:0.0:1788361046.215771:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361046.215775:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.215780:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43000/0xf6a94c97d66117b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361046.224812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.224905:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130450304 00000100:00100000:3.0:1788361046.224916:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130450304 00000100:00100000:3.0:1788361046.224970:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1788361046.224980:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+13:14374:x1875232130450304:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361046.225004:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361046.225023:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66117cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6cf expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.225132:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.225148:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.225161:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361046.225215:0:14227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788361046.225219:0:14227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361046.225239:0:14227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.225249:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.225275:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d66117cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6cf expref: 15 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.225299:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6cf expref: 14 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.225308:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:3.0:1788361046.225311:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361046.225315:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ec00, rc 0) 00000100:00100000:3.0:1788361046.225379:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:14374:x1875232130450304:12345-192.168.203.60@tcp:101:bash.0 Request processed in 400us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361046.225387:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:1.0:1788361046.230964:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361046.231061:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130450560 00000100:00100000:0.0:1788361046.231071:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130450560 00000100:00100000:0.0:1788361046.231172:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361046.231181:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:14374:x1875232130450560:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:0.0:1788361046.232504:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+15:14374:x1875232130450560:12345-192.168.203.60@tcp:35:bash.0 Request processed in 1317us (1542us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788361046.232516:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361046.300172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.300753:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130450816 00000100:00100000:2.0:1788361046.300765:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130450816 00000100:00100000:2.0:1788361046.300828:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:2.0:1788361046.300838:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+15:14384:x1875232130450816:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361046.300862:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361046.300883:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66117db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6d6 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361046.300998:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788361046.301149:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66117db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6d6 expref: 17 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.301176:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:2.0:1788361046.301179:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361046.301185:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66117db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6d6 expref: 17 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.301199:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:2.0:1788361046.301267:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+16:14384:x1875232130450816:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 429us (1104us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788361046.301275:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361046.306760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.308332:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130451072 00000100:00100000:3.0:1788361046.308346:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130451072 00000100:00100000:3.0:1788361046.308447:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361046.308457:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+16:14384:x1875232130451072:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361046.308723:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+17:14384:x1875232130451072:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 266us (1971us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788361046.308730:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361046.335740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.335997:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130451328 00000100:00100000:2.0:1788361046.336007:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130451328 00000100:00100000:2.0:1788361046.336075:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:2.0:1788361046.336113:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+17:14387:x1875232130451328:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361046.336138:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361046.336157:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66117e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6dd expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.336263:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66117f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.336278:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66117f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.336289:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66117f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361046.336301:0:14226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788361046.336432:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66117e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6dd expref: 20 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.336446:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66117f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6dd expref: 19 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.336452:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:2.0:1788361046.336454:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361046.336457:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f000, rc 0) 00000100:00100000:2.0:1788361046.336515:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+19:14387:x1875232130451328:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 432us (789us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788361046.336522:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788361046.339409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.339684:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130451456 00000100:00100000:2.0:1788361046.339694:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130451456 00000100:00100000:2.0:1788361046.339750:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:2.0:1788361046.339760:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+19:14387:x1875232130451456:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:2.0:1788361046.339824:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66117fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.339841:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66117fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.339852:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66117fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.339877:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66117fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.339885:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66117fe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.339909:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66117fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.339927:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361046.339932:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66117fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.339941:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66117fe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.339954:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:2.0:1788361046.339957:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361046.339962:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66117fe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.339968:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66117fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.340060:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+19:14387:x1875232130451456:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 291us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361046.340067:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:1.0:1788361046.346165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361046.346214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361046.346384:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130451840 00000100:00100000:0.0:1788361046.346395:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130451840 00000100:00100000:2.0:1788361046.346488:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130451584 00000100:00100000:2.0:1788361046.346494:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130451584 00000100:00100000:0.0:1788361046.346498:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361046.346511:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+20:14387:x1875232130451840:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361046.346551:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788361046.346561:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+20:2350:x1875232130451584:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361046.346573:0:14212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361046.346597:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66117f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6dd expref: 20 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.346633:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:2.0:1788361046.346638:0:14212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361046.346695:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+19:2350:x1875232130451584:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 135us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361046.346703:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361046.347398:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+19:14387:x1875232130451840:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 888us (1181us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788361046.347408:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:0.0:1788361046.561211:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361046.562175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.562269:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130452096 00000100:00100000:3.0:1788361046.562279:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130452096 00000100:00100000:3.0:1788361046.562396:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:3.0:1788361046.562408:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+19:14418:x1875232130452096:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1788361046.562434:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361046.562454:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611805 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6e4 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.562553:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661180c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.562567:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661180c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.562579:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661180c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361046.562591:0:14227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788361046.562727:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6611805 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6e4 expref: 22 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.562746:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661180c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6e4 expref: 21 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.562755:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:3.0:1788361046.562758:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361046.562762:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e400, rc 0) 00000100:00100000:3.0:1788361046.562820:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+21:14418:x1875232130452096:12345-192.168.203.60@tcp:101:cat.0 Request processed in 414us (652us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788361046.562843:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1788361046.568794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361046.568837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361046.568935:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130452480 00000100:00100000:0.0:1788361046.568953:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130452480 00000100:00100000:0.0:1788361046.569128:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1788361046.569150:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+21:2351:x1875232130452480:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361046.569173:0:14211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361046.569198:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661180c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6e4 expref: 21 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.569216:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:0.0:1788361046.569221:0:14211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361046.569363:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130452352 00000100:00100000:3.0:1788361046.569368:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130452352 00000100:00100000:3.0:1788361046.569396:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361046.569402:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+21:14418:x1875232130452352:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:0.0:1788361046.569914:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+22:2351:x1875232130452480:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 775us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361046.569944:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361046.570274:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+21:14418:x1875232130452352:12345-192.168.203.60@tcp:35:cat.0 Request processed in 859us (1478us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788361046.570282:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361046.615214:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.615589:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130452736 00000100:00100000:2.0:1788361046.615671:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130452736 00000100:00100000:2.0:1788361046.615738:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1788361046.615749:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+21:14424:x1875232130452736:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361046.615774:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361046.615794:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661181a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6eb expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.615892:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.615907:0:14228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c8 expref: 22 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.615915:0:14228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6cf expref: 22 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.615923:0:14228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.615958:0:14228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6cf expref: 22 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.615989:0:14228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6cf expref: 22 pid: 14227 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.616002:0:14228:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14228:1875232144062464:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361046.616426:0:14228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c8 expref: 22 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.616436:0:14228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c8 expref: 22 pid: 16168 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.616446:0:14228:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84854380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14228:1875232144062592:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361046.616683:0:14228:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361046.619978:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361046.620079:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130452864 00000100:00100000:0.0:1788361046.620124:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130452864 00010000:00010000:0.0:1788361046.620164:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6cf expref: 23 pid: 14227 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361046.620213:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361046.620224:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8927c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+23:2350:x1875232130452864:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361046.620238:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361046.620245:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6cf expref: 23 pid: 14227 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.620257:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6cf expref: 23 pid: 14227 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.620279:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:0.0:1788361046.620290:0:14213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.620300:0:14213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.620307:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361046.620375:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8927c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+23:2350:x1875232130452864:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 152us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361046.620382:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00010000:00010000:2.0:1788361046.621779:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66117d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6cf expref: 22 pid: 14227 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.621800:0:14228:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14228:1875232144062464:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361046.621814:0:14228:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84854380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14228:1875232144062592:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361046.621837:0:14228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361046.623645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.623786:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130452992 00000100:00100000:3.0:1788361046.623797:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130452992 00010000:00010000:3.0:1788361046.623837:0:16251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c8 expref: 22 pid: 16168 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361046.623882:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361046.623891:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+22:2349:x1875232130452992:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361046.623907:0:16251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361046.623914:0:16251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c8 expref: 22 pid: 16168 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.623926:0:16251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c8 expref: 22 pid: 16168 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.623948:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42800/0xf6a94c97d66117bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c8 expref: 22 pid: 16168 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.623964:0:16251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:3.0:1788361046.623994:0:16251:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.624004:0:16251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.624012:0:16251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.624038:0:16251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361046.624142:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+21:2349:x1875232130452992:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 251us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361046.624150:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00010000:00010000:2.0:1788361046.624263:0:14228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.624273:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361046.624304:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788361046.624464:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d661181a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6eb expref: 22 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.624481:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6eb expref: 21 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.624488:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:2.0:1788361046.624491:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788361046.624493:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:2.0:1788361046.624521:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+21:14424:x1875232130452736:12345-192.168.203.60@tcp:101:dd.0 Request processed in 8773us (9317us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788361046.624528:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361046.629829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.632126:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130453248 00000100:00100000:2.0:1788361046.632141:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130453248 00000100:00100000:2.0:1788361046.632714:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788361046.632724:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+21:14424:x1875232130453248:12345-192.168.203.60@tcp:36:dd.0 00010000:00010000:2.0:1788361046.632986:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.633004:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.633016:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361046.634008:0:14226:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788361046.635936:0:14226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd60f483 reply state 000000002d118e7b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.635949:0:14226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361046.636116:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+24:14424:x1875232130453248:12345-192.168.203.60@tcp:36:dd.0 Request processed in 3389us (6293us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788361046.636126:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000020:00080000:2.0:1788361046.636132:0:14226:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788361046.641234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361046.641282:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130453376 00000100:00100000:1.0:1788361046.641291:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130453376 00000100:00100000:1.0:1788361046.641339:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788361046.641349:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+24:14424:x1875232130453376:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361046.641371:0:16168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361046.641394:0:16168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9600/0xf6a94c97d6611836 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6f2 expref: -99 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.641451:0:16168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9600/0xf6a94c97d6611836 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f2 expref: 25 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.641467:0:16168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9600/0xf6a94c97d6611836 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f2 expref: 25 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.641485:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:1.0:1788361046.641489:0:16168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361046.641493:0:16168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c9600, rc 0) 00000100:00100000:1.0:1788361046.641541:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+25:14424:x1875232130453376:12345-192.168.203.60@tcp:101:dd.0 Request processed in 193us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361046.641548:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00010000:00010000:3.0:1788361046.642127:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.642136:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.642144:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.642159:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361046.642164:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.642172:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.642184:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:3.0:1788361046.642186:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361046.642190:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.642214:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661182f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361046.661757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361046.661848:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130453632 00000100:00100000:0.0:1788361046.661865:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130453632 00000100:00100000:0.0:1788361046.661917:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1788361046.661924:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+24:14424:x1875232130453632:12345-192.168.203.60@tcp:103:dd.0 00010000:00010000:0.0:1788361046.661936:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361046.661956:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9600/0xf6a94c97d6611836 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f2 expref: 24 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361046.661971:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:0.0:1788361046.661974:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361046.662019:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+23:14424:x1875232130453632:12345-192.168.203.60@tcp:103:dd.0 Request processed in 95us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361046.662026:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:1.0:1788361046.664524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.664627:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130453760 00000100:00100000:3.0:1788361046.664637:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130453760 00000100:00100000:3.0:1788361046.664690:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:3.0:1788361046.664699:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+23:14424:x1875232130453760:12345-192.168.203.60@tcp:58:dd.0 00010000:00010000:3.0:1788361046.664810:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.664828:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.664848:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361046.666709:0:14227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361046.667512:0:14227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788361046.667591:0:14227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788361046.667770:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+23:14424:x1875232130453760:12345-192.168.203.60@tcp:58:dd.0 Request processed in 3066us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361046.667781:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1788361046.672515:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361046.672609:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130453888 00000100:00100000:1.0:1788361046.672632:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130453888 00000100:00100000:1.0:1788361046.672738:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:1.0:1788361046.672748:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+23:14424:x1875232130453888:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361046.672768:0:16168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361046.672787:0:16168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9a00/0xf6a94c97d6611844 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e6f9 expref: -99 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.672846:0:16168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.672857:0:16168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9a00/0xf6a94c97d6611844 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f9 expref: 24 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.672875:0:16168:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.672888:0:16168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9a00/0xf6a94c97d6611844 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f9 expref: 24 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.672901:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:1.0:1788361046.672903:0:16168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361046.672907:0:16168:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9a00/0xf6a94c97d6611844 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f9 expref: 24 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.672915:0:16168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c9a00, rc 0) 00000100:00100000:1.0:1788361046.673767:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+24:14424:x1875232130453888:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1017us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361046.673776:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000001:00080000:0.0:1788361046.757435:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:0.0:1788361046.757460:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1788361046.757468:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:0.0:1788361046.757485:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1788361046.757499:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:0.0:1788361046.944353:0:14260:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788361046.944363:0:14260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361046.944407:0:14260:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788361046.944417:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788361046.944567:0:14260:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14260:1875232144062720:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361046.944691:0:14260:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361046.946869:0:14260:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14260:1875232144062720:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361046.949423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361046.950197:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130454016 00000100:00100000:1.0:1788361046.950208:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130454016 00000100:00100000:1.0:1788361046.950265:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361046.950275:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:14425:x1875232130454016:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788361046.950757:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:14425:x1875232130454016:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 Request processed in 482us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361046.950767:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361046.953925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.954252:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130454144 00000100:00100000:2.0:1788361046.954264:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130454144 00000100:00100000:2.0:1788361046.954372:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1788361046.954382:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:14425:x1875232130454144:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361046.954414:0:14226:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361046.954564:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:14425:x1875232130454144:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 183us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361046.954573:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:1.0:1788361046.958552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.961727:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130454272 00000100:00100000:2.0:1788361046.961746:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130454272 00000100:00100000:2.0:1788361046.961877:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:2.0:1788361046.961889:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:14425:x1875232130454272:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788361046.961965:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661184b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.961983:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661184b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.961995:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661184b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962031:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611852 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962039:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962056:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962108:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962118:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962125:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361046.962165:0:14228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788361046.962169:0:14228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361046.962181:0:14228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962193:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661184b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962200:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661184b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962207:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661184b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962223:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361046.962228:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661184b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962236:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661184b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962248:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a983bf600) 00010000:00010000:2.0:1788361046.962251:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361046.962256:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661184b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962262:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661184b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962276:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962281:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611852 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962287:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611852 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962291:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361046.962294:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611852 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962299:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611852 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962317:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788361046.962319:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361046.962322:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611852 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962328:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611852 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962343:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962348:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962353:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962357:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361046.962360:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962365:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962372:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:2.0:1788361046.962374:0:14228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361046.962377:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.962383:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611859 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.962481:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:14425:x1875232130454272:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 593us (3937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361046.962489:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:0.0:1788361046.965311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.965396:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130454528 00000100:00100000:3.0:1788361046.965407:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130454528 00000100:00100000:3.0:1788361046.965462:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:3.0:1788361046.965472:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:14425:x1875232130454528:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361046.965490:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361046.965520:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6611860 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e700 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965625:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611867 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965641:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965653:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361046.965665:0:14227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788361046.965788:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965796:0:14227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611867 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965803:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611867 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965809:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361046.965812:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611867 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965820:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611867 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965831:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:3.0:1788361046.965834:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788361046.965839:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611867 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965856:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611867 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965898:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6611860 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e700 expref: 13 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965908:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a983bf600) 00010000:00010000:3.0:1788361046.965911:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361046.965915:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6611860 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e700 expref: 13 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.965923:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f200, rc 0) 00000100:00100000:3.0:1788361046.965974:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+12:14425:x1875232130454528:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 503us (672us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788361046.965982:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1788361046.969329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361046.969418:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130454656 00000100:00100000:1.0:1788361046.969429:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130454656 00000100:00100000:1.0:1788361046.969503:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788361046.969513:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+12:14425:x1875232130454656:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788361046.969546:0:16168:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788361046.969667:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+12:14425:x1875232130454656:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 156us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361046.969675:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788361046.973933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361046.974017:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130454912 00000100:00100000:3.0:1788361046.974027:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130454912 00000100:00100000:3.0:1788361046.974132:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1788361046.974143:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+12:14425:x1875232130454912:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361046.974164:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361046.974183:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6611875 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e707 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361046.976308:0:14227:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:3.0:1788361046.976386:0:14227:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1788361046.976441:0:14227:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1788361046.976873:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d661187c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.976898:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d661187c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.976910:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d661187c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.976982:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6611875 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e707 expref: 15 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.977002:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d661187c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e707 expref: 14 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361046.977011:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:3.0:1788361046.977014:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361046.977018:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fc00, rc 0) 00000100:00100000:3.0:1788361046.977307:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:14425:x1875232130454912:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 3164us (3381us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788361046.977326:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1788361046.980850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361046.980938:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130455168 00000100:00100000:1.0:1788361046.980948:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130455168 00000100:00100000:1.0:1788361046.981007:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:1.0:1788361046.981018:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:14425:x1875232130455168:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361046.981119:0:16168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361046.981147:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d661187c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e707 expref: 14 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.981166:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8a99526500) 00010000:00010000:1.0:1788361046.981191:0:16168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361046.981213:0:16168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9c00/0xf6a94c97d661188a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.981227:0:16168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9c00/0xf6a94c97d661188a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.981237:0:16168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9c00/0xf6a94c97d661188a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.981304:0:16168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c8000/0xf6a94c97d6611891 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x174c9150 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.981312:0:16168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c8000/0xf6a94c97d6611891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x174c9150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.981319:0:16168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c8000/0xf6a94c97d6611891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x174c9150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982633:0:16168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9c00/0xf6a94c97d661188a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982647:0:16168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9c00/0xf6a94c97d661188a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982654:0:16168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9c00/0xf6a94c97d661188a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982661:0:16168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361046.982665:0:16168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9c00/0xf6a94c97d661188a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982672:0:16168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9c00/0xf6a94c97d661188a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982696:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a8aa8ee1200) 00010000:00010000:1.0:1788361046.982699:0:16168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361046.982704:0:16168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9c00/0xf6a94c97d661188a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982710:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9c00/0xf6a94c97d661188a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982722:0:16168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c8000/0xf6a94c97d6611891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x174c9150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982729:0:16168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c8000/0xf6a94c97d6611891 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x174c9150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982735:0:16168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c8000/0xf6a94c97d6611891 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x174c9150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982740:0:16168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361046.982743:0:16168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c8000/0xf6a94c97d6611891 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x174c9150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982748:0:16168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c8000/0xf6a94c97d6611891 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x174c9150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982754:0:16168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x174c9150 (ffff9a8a99640c00) 00010000:00010000:1.0:1788361046.982756:0:16168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361046.982758:0:16168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c8000/0xf6a94c97d6611891 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x174c9150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.982763:0:16168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c8000/0xf6a94c97d6611891 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x174c9150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361046.982882:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+13:14425:x1875232130455168:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1863us (2039us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361046.982891:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:1.0:1788361046.986035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.986154:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130455296 00000100:00100000:2.0:1788361046.986164:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130455296 00000100:00100000:2.0:1788361046.986215:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:2.0:1788361046.986224:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+13:14425:x1875232130455296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361046.986242:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361046.986262:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611898 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e70e expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.986311:0:14226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661189f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.986332:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661189f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.986343:0:14226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661189f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.986433:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611898 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e70e expref: 15 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.986449:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661189f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e70e expref: 14 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.986457:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788361046.986465:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361046.986469:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:2.0:1788361046.986526:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:14425:x1875232130455296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 302us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361046.986532:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:3.0:1788361046.990307:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361046.990817:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130455552 00000100:00100000:2.0:1788361046.990828:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130455552 00000100:00100000:2.0:1788361046.990890:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:2.0:1788361046.990900:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:14425:x1875232130455552:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361046.990981:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.990998:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.991009:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361046.991916:0:14228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788361046.991929:0:14228:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437006842508ns, next at 438006840243ns, rc = 0 00000004:00010000:2.0:1788361046.992019:0:14228:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ffb8c6f6 reply state 0000000040246c82 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.992029:0:14228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361046.992442:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+16:14425:x1875232130455552:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1541us (2141us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788361046.992452:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1788361046.996744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:1.0:1788361046.996923:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.996935:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.996942:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.996947:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361046.996953:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.996960:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.996977:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:1.0:1788361046.996980:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788361046.996984:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361046.996991:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66118a6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361046.997378:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130455680 00000100:00100000:2.0:1788361046.997388:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130455680 00000100:00100000:2.0:1788361046.997499:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:2.0:1788361046.997509:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+15:14425:x1875232130455680:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361046.997533:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361046.997549:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66118ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e715 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.997726:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66118ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e715 expref: 16 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.997742:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66118ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e715 expref: 16 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361046.997761:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788361046.997764:0:14226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361046.997767:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f200, rc 0) 00000100:00100000:2.0:1788361046.997829:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+16:14425:x1875232130455680:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 321us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361046.997837:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:1.0:1788361047.000800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361047.000941:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130455808 00000100:00100000:3.0:1788361047.000951:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130455808 00000100:00100000:3.0:1788361047.001017:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361047.001028:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2350:x1875232130455808:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788361047.001164:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361047.001807:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:2350:x1875232130455808:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 779us (1013us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788361047.001826:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361047.004549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361047.004700:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130456064 00000100:00100000:2.0:1788361047.004709:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130456064 00000100:00100000:2.0:1788361047.004783:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361047.004792:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+16:14425:x1875232130456064:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361047.005023:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+17:14425:x1875232130456064:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 231us (483us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788361047.005031:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:1.0:1788361047.005154:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361047.006913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361047.006992:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130456320 00000100:00100000:1.0:1788361047.007000:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130456320 00000100:00100000:1.0:1788361047.007069:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1788361047.007079:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+17:14425:x1875232130456320:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788361047.007207:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+17:14425:x1875232130456320:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 130us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361047.007215:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:0.0:1788361047.009752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361047.009885:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130456448 00000100:00100000:3.0:1788361047.009895:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130456448 00000100:00100000:3.0:1788361047.009954:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788361047.009963:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+17:14425:x1875232130456448:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361047.009982:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361047.010002:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d66118b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e71c expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.010433:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66118bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.010449:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66118bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.010464:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66118bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361047.011996:0:14227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361047.012105:0:14227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66118bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.012142:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d66118b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e71c expref: 19 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.012160:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66118bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e71c expref: 18 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.012169:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:0.0:1788361047.012172:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788361047.012176:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f200, rc 0) 00000100:00100000:0.0:1788361047.012246:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+18:14425:x1875232130456448:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2283us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361047.012255:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788361047.014996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361047.015114:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130456576 00000100:00100000:1.0:1788361047.015123:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130456576 00000100:00100000:1.0:1788361047.015177:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361047.015187:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+6:2350:x1875232130456576:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361047.015203:0:14865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361047.015223:0:14865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb0792f5/0xf6a94c97d66118c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e723 expref: -99 pid: 14865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361047.015246:0:14865:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983957, blocks: 0x1 00010000:00010000:1.0:1788361047.015264:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1788361047.015268:0:14865:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361047.015278:0:14865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0792f5/0xf6a94c97d66118c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e723 expref: 7 pid: 14865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.015294:0:14865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb0792f5/0xf6a94c97d66118c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e723 expref: 7 pid: 14865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.015338:0:14865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c8e00, rc 0) 00000100:00100000:1.0:1788361047.015398:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:2350:x1875232130456576:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 212us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361047.015405:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361047.020737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361047.020824:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130456832 00000100:00100000:2.0:1788361047.020846:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130456832 00000100:00100000:2.0:1788361047.020904:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:2.0:1788361047.020915:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+18:14425:x1875232130456832:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788361047.021026:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+18:14425:x1875232130456832:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361047.021034:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:0.0:1788361047.023542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361047.023610:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130456960 00000100:00100000:2.0:1788361047.023619:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130456960 00000100:00100000:2.0:1788361047.023768:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1788361047.023779:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+18:14425:x1875232130456960:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788361047.077745:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788361047.077766:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788361047.077966:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:14425:x1875232130456960:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 54184us (54427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361047.077977:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:1.0:1788361047.078690:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361047.080199:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361047.080288:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144062848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788361047.080339:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361047.080452:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130457088 00000100:00100000:3.0:1788361047.080459:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130457088 00000100:00100000:3.0:1788361047.080501:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144062848 00000100:00100000:3.0:1788361047.080505:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144062848 00000100:00100000:3.0:1788361047.080552:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361047.080566:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:2349:x1875232130457088:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788361047.080656:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:2349:x1875232130457088:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 96us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361047.080672:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788361047.080679:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361047.080680:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144062848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788361047.080823:0:14865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788361047.080827:0:14865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788361047.080829:0:14865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361047.080831:0:14865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788361047 -> 1788361047 00002000:00010000:1.0:1788361047.080834:0:14865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:2.0:1788361047.081006:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361047.083243:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144062848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2552us (2892us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788361047.083257:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1788361047.083751:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a89858aed80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788361047.083759:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144062848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788361047.083799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361047.083848:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130457344 00000100:00100000:2.0:1788361047.083855:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130457344 00000100:00100000:2.0:1788361047.083904:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:2.0:1788361047.083913:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:14425:x1875232130457344:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361047.083965:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361047.083989:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d66118bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e71c expref: 14 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361047.084007:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788361047.084011:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361047.084039:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361047.084065:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361047.084142:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361047.084345:0:14228:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e858821b reply state 000000008112dff3 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361047.084355:0:14228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361047.084453:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+15:14425:x1875232130457344:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 541us (655us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788361047.084460:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00010000:00010000:3.0:1788361047.086602:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.086617:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.086624:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.086631:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361047.086636:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.086645:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.086661:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:3.0:1788361047.086664:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361047.086670:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.086675:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361047.086859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361047.087510:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130457472 00000100:00100000:3.0:1788361047.087520:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130457472 00000100:00100000:3.0:1788361047.087715:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361047.087734:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:14425:x1875232130457472:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361047.087751:0:14862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361047.087765:0:14862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e72a expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.087793:0:14862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb0792f5/0xf6a94c97d66118c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e723 expref: 8 pid: 14865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.087801:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361047.087805:0:14862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361047.087809:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 8 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.087839:0:14862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb0792f5/0xf6a94c97d66118c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e723 expref: 8 pid: 14865 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.087850:0:14862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb0792f5/0xf6a94c97d66118c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e723 expref: 8 pid: 14865 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361047.087863:0:14862:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14862:1875232144062976:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361047.087936:0:14862:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361047.090649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361047.090692:0:14862:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14862:1875232144062976:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361047.090725:0:14862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 8 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.090765:0:14862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fe00, rc 0) 00000100:00100000:1.0:1788361047.090774:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130457600 00000100:00100000:1.0:1788361047.090780:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130457600 00010000:00010000:1.0:1788361047.090811:0:16251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0792f5/0xf6a94c97d66118c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e723 expref: 9 pid: 14865 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361047.090826:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:14425:x1875232130457472:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 3094us (3971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361047.090834:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361047.091011:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361047.091021:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+8:2349:x1875232130457600:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361047.091036:0:16251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361047.091068:0:16251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb0792f5/0xf6a94c97d66118c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e723 expref: 8 pid: 14865 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.091081:0:16251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb0792f5/0xf6a94c97d66118c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e723 expref: 8 pid: 14865 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.091235:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb0792f5/0xf6a94c97d66118c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e723 expref: 8 pid: 14865 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.091249:0:16251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361047.091254:0:16251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361047.091261:0:16251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 7 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.091272:0:16251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 7 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.091307:0:16251:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 7 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361047.091334:0:16251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89265180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16251:1875232144063104:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361047.091391:0:16251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361047.095004:0:16251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89265180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16251:1875232144063104:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361047.095030:0:16251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361047.095105:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:2349:x1875232130457600:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 4085us (4466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361047.095116:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361047.099503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361047.099714:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130457728 00000100:00100000:1.0:1788361047.099730:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130457728 00000100:00100000:1.0:1788361047.099795:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:1.0:1788361047.099805:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:2350:x1875232130457728:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788361047.100026:0:14865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788361047.100030:0:14865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788361047 00002000:00010000:1.0:1788361047.100032:0:14865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788361046 00002000:00010000:1.0:1788361047.100034:0:14865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788361047 -> 1788361047 00002000:00010000:1.0:1788361047.100036:0:14865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788361047.100829:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+8:2350:x1875232130457728:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 1021us (1333us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788361047.100840:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361047.104857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361047.105022:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130457856 00000100:00100000:0.0:1788361047.105031:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130457856 00000100:00100000:0.0:1788361047.105149:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361047.105160:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+8:2349:x1875232130457856:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788361047.105220:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.105243:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 8 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.105253:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361047.105257:0:14864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361047.105261:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.105299:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 8 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.105313:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 8 pid: 14862 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.105329:0:14864:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14864:1875232144063232:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361047.105412:0:14864:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361047.108714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361047.108748:0:14864:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14864:1875232144063232:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361047.108774:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.108844:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130457984 00000100:00100000:0.0:1788361047.108850:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130457984 00010000:00010000:0.0:1788361047.108879:0:14213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 9 pid: 14862 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.108916:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788361047.108924:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:2350:x1875232130457984:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361047.108943:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361047.108963:0:14213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 9 pid: 14862 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.108976:0:14213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 9 pid: 14862 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.108998:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66118d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e72a expref: 9 pid: 14862 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.109012:0:14213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361047.109017:0:14213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361047.109023:0:14213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.109033:0:14213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.109060:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361047.109226:0:14864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.109236:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.109258:0:14864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.109435:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+8:2350:x1875232130457984:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 510us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361047.109443:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:1.0:1788361047.109809:0:14864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.109819:0:14864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.109826:0:14864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361047.109830:0:14864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.109840:0:14864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.109853:0:14864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.109873:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd01783e/0xf6a94c97d66118d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361047.109934:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:2349:x1875232130457856:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 4777us (5088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361047.109941:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1788361047.113876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361047.113984:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130458240 00000100:00100000:0.0:1788361047.113994:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130458240 00000100:00100000:0.0:1788361047.114139:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:0.0:1788361047.114151:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:14425:x1875232130458240:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788361047.114276:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66118de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.114298:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66118de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.114311:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66118de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.114573:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.114586:0:14227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66118ad lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e715 expref: 15 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.114594:0:14227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.114629:0:14227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66118ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e715 expref: 15 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.114644:0:14227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66118ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e715 expref: 15 pid: 14226 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.114657:0:14227:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14227:1875232144063360:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361047.114732:0:14227:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361047.117683:0:14227:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83541180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14227:1875232144063360:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361047.117713:0:14227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361047.119515:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361047.119578:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130458368 00000100:00100000:0.0:1788361047.119589:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130458368 00010000:00010000:0.0:1788361047.119632:0:14211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66118ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e715 expref: 16 pid: 14226 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.119677:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1788361047.119687:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+16:2349:x1875232130458368:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361047.119703:0:14211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361047.119711:0:14211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66118ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e715 expref: 16 pid: 14226 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.119724:0:14211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66118ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e715 expref: 16 pid: 14226 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.119745:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66118ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e715 expref: 16 pid: 14226 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.119761:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:0.0:1788361047.119768:0:14211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.119777:0:14211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.119785:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.119817:0:14211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361047.119889:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+15:2349:x1875232130458368:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 202us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361047.119896:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00010000:00010000:2.0:1788361047.120010:0:14227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361047.120018:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361047.120278:0:14227:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788361047.120439:0:14227:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788361047.120489:0:14227:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788361047.120589:0:14227:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84856d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14227:1875232144063488:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788361047.120695:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361047.120730:0:14227:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361047.120968:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144063488 00000100:00100000:3.0:1788361047.120974:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144063488 00000100:00100000:3.0:1788361047.121012:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361047.121021:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14227:x1875232144063488:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788361047.121126:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14227:x1875232144063488:12345-0@lo:1000:mdt00_001.0 Request processed in 106us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361047.121133:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361047.121171:0:14227:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84856d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14227:1875232144063488:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788361047.121844:0:14227:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788361047.121917:0:14227:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14227:1875232144063616:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788361047.121964:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361047.121990:0:14227:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8529ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361047.122005:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144063616 00000100:00100000:3.0:1788361047.122010:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144063616 00000100:00100000:3.0:1788361047.122037:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361047.122053:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14227:x1875232144063616:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788361047.122227:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14227:x1875232144063616:12345-0@lo:1000:mdt00_001.0 Request processed in 183us (262us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788361047.122234:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361047.122630:0:14227:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83541180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14227:1875232144063616:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788361047.122661:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122671:0:14227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122678:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122683:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361047.122687:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122694:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122709:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:0.0:1788361047.122711:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361047.122716:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122733:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42200/0xf6a94c97d66118e5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122765:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122773:0:14227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122778:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122784:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361047.122787:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122793:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122802:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:0.0:1788361047.122804:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361047.122810:0:14227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9a00/0xf6a94c97d6611844 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f9 expref: 18 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122820:0:14227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9a00/0xf6a94c97d6611844 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f9 expref: 18 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122829:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9a00/0xf6a94c97d6611844 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f9 expref: 18 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.122891:0:14227:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9a00/0xf6a94c97d6611844 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f9 expref: 18 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.122902:0:14227:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14227:1875232144063744:192.168.203.60@tcp:105: 00000100:00100000:0.0:1788361047.122970:0:14227:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8529ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361047.125193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361047.125200:0:14227:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14227:1875232144063744:192.168.203.60@tcp:105: 00010000:00010000:0.0:1788361047.125224:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125236:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661183d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125268:0:14227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66118ec lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125281:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66118ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125292:0:14227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66118ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125303:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66118ec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125309:0:14227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66118ec lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125326:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66118ec lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125350:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361047.125354:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66118ec lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125361:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66118ec lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125374:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:0.0:1788361047.125377:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361047.125381:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66118ec lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125387:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42000/0xf6a94c97d66118ec lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125399:0:14227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66118de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125405:0:14227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66118de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125412:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66118de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125417:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361047.125419:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66118de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125426:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66118de lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125446:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:0.0:1788361047.125448:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361047.125452:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66118de lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.125458:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c43800/0xf6a94c97d66118de lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.125699:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+18:14425:x1875232130458240:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 11550us (11831us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788361047.125710:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000020:00080000:0.0:1788361047.125715:0:14227:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788361047.125780:0:14260:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788361047.125803:0:14260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361047.125833:0:14260:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788361047.125843:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788361047.128213:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130458496 00000100:00100000:2.0:1788361047.128226:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130458496 00000100:00100000:2.0:1788361047.128283:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1788361047.128292:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9ea48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+18:14424:x1875232130458496:12345-192.168.203.60@tcp:49:dd.0 00000100:00100000:2.0:1788361047.128437:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9ea48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+18:14424:x1875232130458496:12345-192.168.203.60@tcp:49:dd.0 Request processed in 146us (3253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361047.128444:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361047.135905:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361047.136173:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130458752 00000100:00100000:2.0:1788361047.136184:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130458752 00000100:00100000:2.0:1788361047.136239:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788361047.136249:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+18:14425:x1875232130458752:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788361047.138069:0:14229:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788361047.138755:0:14229:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788361047.138828:0:14229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361047.138847:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361047.138860:0:14229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361047.138868:0:14229:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361047.138874:0:14229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361047.138880:0:14229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361047.138957:0:14229:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788361047.139080:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+20:14425:x1875232130458752:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 2828us (3180us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788361047.139134:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000020:00080000:2.0:1788361047.139140:0:14229:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788361047.140562:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361047.140573:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.140583:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361047.140588:0:14215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.140658:0:14215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.140677:0:14215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:0.0:1788361047.140681:0:14215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361047.140686:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.140693:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66118f3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14229 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.140726:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361047.140727:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361047.140729:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361047.200432:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361047.200459:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144063872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361047.200499:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361047.200509:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144064000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361047.200551:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361047.200590:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144064000 00000100:00100000:2.0:1788361047.200598:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144064000 00000100:00100000:0.0:1788361047.200738:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144064256:0@lo:400:kworker.0 00000100:00100000:3.0:1788361047.200744:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b97d369-4bf1-43ee-a977-45b88f10e003:3313:1875232144064128:0@lo:400:kworker.0 00000100:00100000:2.0:1788361047.200781:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361047.201456:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361047.201520:0:15711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144064256 00000100:00100000:0.0:1788361047.201525:0:15711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144064256 00000100:00100000:0.0:1788361047.201557:0:15711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361047.201658:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144064000:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361047.201662:0:15711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144064256:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788361047.201702:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788361047.201718:0:15711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144064256:12345-0@lo:400:kworker.0 Request processed in 56us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361047.201725:0:15711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361047.201736:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144064000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 948us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361047.201742:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788361047.201759:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361047.201767:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144064256:0@lo:400:kworker.0 00000100:00100000:2.0:1788361047.201778:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361047.201801:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144064512:0@lo:400:kworker.0 00000100:00100000:0.0:1788361047.201804:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144063872 00000100:00100000:0.0:1788361047.201807:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144063872 00000100:00100000:2.0:1788361047.201830:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361047.201843:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361047.201847:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361047.201849:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144063872:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361047.201852:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144064384:0@lo:400:kworker.0 00000100:00100000:2.0:1788361047.201872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788361047.201878:0:16006:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788361047.201901:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144064512 00000100:00100000:2.0:1788361047.201904:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144064512 00000100:00100000:0.0:1788361047.201910:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144063872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361047.201916:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361047.201930:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144064384 00000100:00100000:2.0:1788361047.201933:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144064384 00000100:00100000:0.0:1788361047.201946:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788361047.201950:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361047.201952:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144064512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361047.201955:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144064384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361047.201982:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144064384:12345-0@lo:400:kworker.0 Request processed in 26us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361047.201982:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144064512:12345-0@lo:400:kworker.0 Request processed in 29us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361047.202000:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361047.202007:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788361047.202015:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361047.202031:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144064384:0@lo:400:kworker.0 00000100:00100000:2.0:1788361047.202041:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144064512:0@lo:400:kworker.0 00000100:00100000:2.0:1788361047.202065:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144063872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361047.203737:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144064000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361047.204184:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361047.204279:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144064640:0@lo:400:kworker.0 00000100:00100000:3.0:1788361047.204312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361047.205183:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144064640 00000100:00100000:0.0:1788361047.205192:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144064640 00000100:00100000:0.0:1788361047.205272:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361047.205282:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144064640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361047.205347:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144064640:12345-0@lo:400:kworker.0 Request processed in 67us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361047.205354:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788361047.205537:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361047.205537:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144064128 00000100:00100000:2.0:1788361047.205542:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144064128 00000100:00100000:1.0:1788361047.205579:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144064640:0@lo:400:kworker.0 00000100:00100000:2.0:1788361047.205644:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788361047.205652:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3313:x1875232144064128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361047.205701:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3313:x1875232144064128:12345-0@lo:400:kworker.0 Request processed in 50us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361047.205708:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788361047.205806:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b97d369-4bf1-43ee-a977-45b88f10e003:3313:1875232144064128:0@lo:400:kworker.0 00000100:00100000:0.0:1788361047.266869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361047.266981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361047.267322:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130458880 00000100:00100000:1.0:1788361047.267335:0:14868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130458880 00000100:00100000:1.0:1788361047.267408:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130459008 00000100:00100000:1.0:1788361047.267412:0:14868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130459008 00000100:00100000:1.0:1788361047.267435:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361047.267447:0:14868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+8:2352:x1875232130458880:12345-192.168.203.60@tcp:4:dd.0 00002000:00010000:1.0:1788361047.267587:0:14868:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a983957, atime: 0x6a983956, ctime: 0x6a983957, blocks: 0x1 00010000:00010000:1.0:1788361047.267599:0:14868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d66118fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.267619:0:14868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1788361047.267624:0:14868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361047.267632:0:14868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d66118fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.267658:0:14868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d66118fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361047.270694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361047.270732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361047.270799:0:14869:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788361047.270808:0:14869:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788361047.271051:0:14869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130459136 00000100:00100000:3.0:1788361047.271060:0:14869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130459136 00000100:00100000:3.0:1788361047.271137:0:14869:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788361047.271145:0:14869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130459264 00000100:00100000:3.0:1788361047.271149:0:14869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130459264 00000100:00100000:0.0:1788361047.271688:0:16365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1788361047.271710:0:16365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:2352:x1875232130459008:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:0.0:1788361047.271742:0:16365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6611901 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.271759:0:16365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361047.271764:0:16365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361047.271770:0:16365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6611901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.271784:0:16365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6611901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361047.272528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361047.272673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361047.273022:0:14869:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788361047.273294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361047.273314:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788361047.277831:0:14869:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788361047.279268:0:14870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130459392 00000100:00100000:0.0:1788361047.279282:0:14870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130459392 00000100:00100000:2.0:1788361047.279463:0:14869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130459520 00000100:00100000:2.0:1788361047.279468:0:14869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130459520 00000100:00100000:2.0:1788361047.279503:0:14869:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788361047.279503:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788361047.279516:0:14869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130459648 00000100:00100000:2.0:1788361047.279520:0:14869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130459648 00000100:00100000:3.0:1788361047.280314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361047.281462:0:14869:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788361047.281477:0:14869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130459776 00000100:00100000:2.0:1788361047.281484:0:14869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130459776 00000100:00100000:1.0:1788361047.282057:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:1.0:1788361047.282070:0:16366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b731a8db-84ff-4db6-8c11-a2dda6e4d993+16:2352:x1875232130459136:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:1.0:1788361047.283462:0:16366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611908 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.283485:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361047.283489:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361047.283496:0:16366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.283513:0:16366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361047.376956:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1788361047.376977:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1788361047.376994:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1788361047.377015:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1788361047.377193:0:14868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1788361047.377198:0:14868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1788361047.377213:0:14868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d66118fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.377227:0:14868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d66118fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.377255:0:14868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d66118fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.377262:0:14868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361047.377267:0:14868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d66118fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.377277:0:14868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d66118fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.377299:0:14868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d66118fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.377317:0:14868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d66118fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361047.377405:0:14868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+18:2352:x1875232130458880:12345-192.168.203.60@tcp:4:dd.0 Request processed in 109956us (110544us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788361047.377416:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361047.377450:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1788361047.377461:0:14868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+17:2352:x1875232130459264:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:1.0:1788361047.377496:0:14868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac8ca6f/0xf6a94c97d661190f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.377509:0:14868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361047.377519:0:14868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361047.377526:0:14868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac8ca6f/0xf6a94c97d661190f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.377539:0:14868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac8ca6f/0xf6a94c97d661190f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361047.415125:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1788361047.415443:0:16365:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1788361047.415448:0:16365:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:3.0:1788361047.415463:0:16365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6611901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.415476:0:16365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6611901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.415486:0:16365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6611901 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.415511:0:16365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361047.415517:0:16365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6611901 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.415527:0:16365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6611901 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.415547:0:16365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6611901 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.415568:0:16365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c58ccb1/0xf6a94c97d6611901 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361047.415658:0:16365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+15:2352:x1875232130459008:12345-192.168.203.60@tcp:4:dd.0 Request processed in 143955us (148672us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788361047.415669:0:16365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361047.415702:0:16365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361047.415713:0:16365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:2352:x1875232130459392:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:3.0:1788361047.415743:0:16365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6611916 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.415755:0:16365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361047.415759:0:16365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361047.415766:0:16365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6611916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.415789:0:16365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6611916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.416274:0:16366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.416285:0:16366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.416292:0:16366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611908 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.416298:0:16366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361047.416301:0:16366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611908 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.416374:0:16366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611908 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.416388:0:16366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611908 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.416396:0:16366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611908 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361047.416450:0:16366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:2352:x1875232130459136:12345-192.168.203.60@tcp:4:dd.0 Request processed in 134383us (145763us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788361047.416458:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:1.0:1788361047.416481:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361047.416489:0:16366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b731a8db-84ff-4db6-8c11-a2dda6e4d993+13:2351:x1875232130459520:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:1.0:1788361047.416508:0:16366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d661191d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.416517:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361047.416520:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361047.416525:0:16366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d661191d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361047.416534:0:16366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d661191d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361047.465686:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1788361047.465828:0:14868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:3.0:1788361047.465833:0:14868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788361047.465847:0:14868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac8ca6f/0xf6a94c97d661190f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.465859:0:14868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ac8ca6f/0xf6a94c97d661190f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.465868:0:14868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ac8ca6f/0xf6a94c97d661190f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.465876:0:14868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361047.465880:0:14868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac8ca6f/0xf6a94c97d661190f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.465889:0:14868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac8ca6f/0xf6a94c97d661190f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.465908:0:14868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ac8ca6f/0xf6a94c97d661190f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.465915:0:14868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac8ca6f/0xf6a94c97d661190f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361047.466017:0:14868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+15:2352:x1875232130459264:12345-192.168.203.60@tcp:4:dd.0 Request processed in 88554us (195278us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788361047.466028:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1788361047.466074:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361047.466114:0:14868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:2352:x1875232130459648:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:3.0:1788361047.466148:0:14868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d6611924 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.466160:0:14868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361047.466165:0:14868:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361047.466171:0:14868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d6611924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.466184:0:14868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d6611924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361047.515575:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1788361047.515846:0:16365:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1788361047.515851:0:16365:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1788361047.515868:0:16365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6611916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.515882:0:16365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6611916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.515892:0:16365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6611916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.515912:0:16365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361047.515918:0:16365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6611916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.515929:0:16365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6611916 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.515950:0:16365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6611916 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.515960:0:16365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6611916 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.516065:0:16366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d661191d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.516076:0:16366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d661191d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.516104:0:16366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d661191d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.516113:0:16366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361047.516117:0:16366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d661191d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.516125:0:16366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d661191d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.516138:0:16366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d661191d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.516145:0:16366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d661191d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.516213:0:16366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b731a8db-84ff-4db6-8c11-a2dda6e4d993+11:2351:x1875232130459520:12345-192.168.203.60@tcp:4:dd.0 Request processed in 99720us (243535us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788361047.516232:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361047.516262:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361047.516272:0:16366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b731a8db-84ff-4db6-8c11-a2dda6e4d993+10:2351:x1875232130459776:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:0.0:1788361047.516304:0:16366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e62fa7a3/0xf6a94c97d661192b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.516322:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361047.516327:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361047.516333:0:16366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62fa7a3/0xf6a94c97d661192b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.516345:0:16366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62fa7a3/0xf6a94c97d661192b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.529034:0:16365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+13:2352:x1875232130459392:12345-192.168.203.60@tcp:4:dd.0 Request processed in 113312us (256499us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788361047.529057:0:16365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000001:00080000:2.0:1788361047.557690:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1788361047.558186:0:14868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1788361047.558192:0:14868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1788361047.558207:0:14868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d6611924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.558219:0:14868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d6611924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.558228:0:14868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d6611924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.558236:0:14868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361047.558254:0:14868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d6611924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.558265:0:14868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d6611924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.558284:0:14868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d6611924 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361047.558291:0:14868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a11ea5e7/0xf6a94c97d6611924 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361047.558440:0:14868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+9:2352:x1875232130459648:12345-192.168.203.60@tcp:4:dd.0 Request processed in 92352us (285141us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788361047.558452:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00010000:00010000:3.0:1788361047.585108:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361047.588892:0:16366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788361047.588912:0:16366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e62fa7a3/0xf6a94c97d661192b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.588926:0:16366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e62fa7a3/0xf6a94c97d661192b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.588934:0:16366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e62fa7a3/0xf6a94c97d661192b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.588958:0:16366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361047.588962:0:16366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e62fa7a3/0xf6a94c97d661192b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.588972:0:16366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e62fa7a3/0xf6a94c97d661192b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.588990:0:16366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e62fa7a3/0xf6a94c97d661192b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361047.588997:0:16366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62fa7a3/0xf6a94c97d661192b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361047.589141:0:16366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b731a8db-84ff-4db6-8c11-a2dda6e4d993+7:2351:x1875232130459776:12345-192.168.203.60@tcp:4:dd.0 Request processed in 72866us (308826us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788361047.589151:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000001:00080000:2.0:1788361047.589248:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1788361048.610639:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361048.714364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361048.714410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361048.714492:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130460032 00000100:00100000:0.0:1788361048.714502:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130460032 00000100:00100000:0.0:1788361048.714616:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:0.0:1788361048.714628:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+20:2350:x1875232130460032:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361048.714662:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130459904 00000100:00100000:3.0:1788361048.714676:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130459904 00000100:00100000:3.0:1788361048.714711:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1788361048.714717:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+20:2350:x1875232130460032:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 88us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361048.714724:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:2350:x1875232130459904:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361048.714732:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1788361048.714756:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:2350:x1875232130459904:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361048.714761:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:2.0:1788361048.715082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361048.715244:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361048.717634:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130460288 00000100:00100000:3.0:1788361048.717649:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130460288 00000100:00100000:2.0:1788361048.717738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361048.717918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361048.717954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361048.718026:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130460544 00000100:00100000:0.0:1788361048.718045:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130460544 00000100:00100000:0.0:1788361048.718075:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130460160 00000100:00100000:0.0:1788361048.718078:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130460160 00000100:00100000:0.0:1788361048.718111:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361048.718120:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2349:x1875232130460288:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361048.718198:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2349:x1875232130460288:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 78us (3116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361048.718205:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361048.718223:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361048.718229:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2349:x1875232130460544:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361048.718253:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2349:x1875232130460544:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 24us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361048.718260:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361048.718271:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361048.718277:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2349:x1875232130460160:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361048.718310:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2349:x1875232130460160:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361048.718316:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:3.0:1788361048.718532:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361048.720589:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130460416 00000100:00100000:2.0:1788361048.720603:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130460416 00000100:00100000:2.0:1788361048.720676:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788361048.720686:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2349:x1875232130460416:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361048.720762:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2349:x1875232130460416:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 76us (2843us total) trans 0 rc 0/0 00000100:00080000:3.0:1788361048.721019:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361048.721150:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361048.721682:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130460672 00000100:00100000:0.0:1788361048.721689:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130460672 00000100:00100000:1.0:1788361048.722815:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361048.722825:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2349:x1875232130460672:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:3.0:1788361048.722869:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361048.722893:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2349:x1875232130460672:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 69us (4937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361048.722901:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000001:02000400:0.0:1788361048.760686:0:16404:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:3.0:1788361049.184443:0:14260:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788361049.184453:0:14260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361049.184494:0:14260:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788361049.184500:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788361049.633306:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28347 lines, 28347 kept, 0 dropped, 0 bad.